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ON THE CUMULANTS OF RENEWAL PROCESSES 


By WALTER L. SMITH} 


DEDICATED TO THE MEMORY OF JOHN WISHART 


1. INTRODUCTION 


Let X,, X5, Xz, ... be a renewal process; that is, a sequence of independent, non-negative, and 
identically distributed random variables which are not all zero with probability one. If 
there is a real, strictly positive 6 such that, with probability one, all the X; are divisible by 6, 
then we shall call the renewal process discrete. A renewal process which is not discrete is 
termed continuous. Write F(.) for the distribution function of X, and pw, = €X{(< 0), 
S, = X,+X,+...+X,, and F,(.) for the distribution function of S,.. 

Xenewal theory is concerned primarily with the random variable N, which is defined to be 
the maximum suffix k for which S,, < ¢, subject to the convention N, = 0 if X, >t. In the 
obvious renewal application the X; represent, successive lifetimes of the object being 
renewed, and N, is the number of renewals made by time ¢ (subject to the original object 
having been installed at time 0). However, renewal theory has proved to be of significance 
in a wide range of investigations. We mention the theory of queues (Smith, 1953; Bene§, 
1957), the theory of electronic counters (Takacs, 1956; Smith, 1957), the theory of regenera- 
tive stochastic processes (Smith, 1955), the study of the variance-time curve, in its applica- 
tion to problems of nerve physiology (Cox & Smith, 1954; Cox, 1955), and the theory of 
cricket scores (Skellam & Shenton, 1957). 

Previous theoretical work on renewal theory has been concerned almost exclusively (for 
very good reasons) with the first moment &N,. We refer to papers by Feller (1941), (1949), 
Tacklind (1945), Blackwell (1948), and Smith (1954). A typical result concerning @N,is that 
if the renewal process is continuous and jv. < 00, then as t > +0, 


€N,=~4 ($3, - 7 +0(1). 
fy \4/4 

This theorem was first proved, under slightly unnecessary restrictions, by Tacklind (1945), 

and in its final form by Smith (1954) (see also, Smith, 1957). 

The study of higher moments of N,seems to have been neglected, apart from a rather non- 
rigorous and short account by Skellam & Shenton (1957). Feller (1949) proves a theorem 
concerning the variance of N, in the discrete renewal process, and Smith (1954) proves the 
corresponding result for continuous renewal processes: if “7. < 00 then ast > +00 

2 
var N, = se t+o(t). 
4 
A result of Cox & Smith (1954) concerning a related ‘equilibrium’ renewal process also 
suggests that if ~, <0oo then there are constants A and B such that as t+ +0, 
var VN, = At+ B+o(1). A proof of such a result does not seem to be available, and nothing 
appears to have been established concerning the higher cumulants of N,. It is with these 
higher cumulants that the present paper is concerned. 
+ This paper was prepared with the partial support of the Office of Naval Research. 
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The theorems concerning N, which are mentioned above have all been proved without 
irrelevant assumptions concerning F(.). However, reference to Smith (1954) will show that 
a very special type of argument was needed to prove that var N, ~ At, which shows no pros- 
pect of generalizing to higher moments of N,, nor of yielding the linear approximation 
At+ B. Write FS for the class of distribution functions F(.) for which F,,(.), for some finite k, 
has an absolutely continuous component. The present discussion of the higher cumulants of 
N,, for continuous renewal processes, will be based on the weak, but extraneous, assumption 
that F(.)eS. This assumption is assumed to hold throughout this paper even when not men- 
tioned. It will be noticed that once this extra assumption has been made the investigation 
proceeds with little real difficulty. Moreover, the fact that F(.)¢S will be found to imply 
certain variational properties of remainder terms that arise. 

The paper falls naturally into two parts. The first part (§§ 2-5) is concerned with the rigorous 
proof that the nth cumulant of N, has a linear asymptotic form, under general conditions. 
Two theorems (Theorems 3 and 4) are proved, which are jointly equivalent to the following. 


THEOREM 0. If F(.)€eS and fy. 54, < ©, p > O, then there exist constants a, and b,, such 


that the nth cumulant of N, is given by 


At) 
Ant+b, +40’ 


where A(t) is of bounded total variation, is 0(1) as t > +00, satisfies the condition 
A(t) —A(t—a) = o(t-*) 


as t -> +00 for every fixed a > 0, and when p > 1 has the additional property that X(t)/(1+t) 
belongs to the class L,. 

This theorem substantially generalizes Theorems 8, 9, and 10 of Smith (1954) which were 
concerned with different aspects of Theorem 0 in the case n = 1. 

The second part of the paper (§§ 6, 7) is concerned with the evaluation of a,, and b,, in terms 
of the ,. Their values are given for n = 1, 2,...,8. 

In §2 we introduce certain unconventional moments and cumulants which are more 
convenient in the present investigation than the conventional ones, and we study their 
properties. In §3 a number of preliminary lemmas are proved, including in particular 
Lemma 4 which implies a property of the remainder term in Taylor expansions of charac- 
teristic functions which we believe to be of independent interest. In §4 we develop a sym- 
bolic calculus for dealing with complicated Laplace transforms that arise and use this 
calculus to prove Theorems 1 and 2 concerning the asymptotic behaviour of moments of 
N,. These results are preparatory to §5 in which Theorem 0, above, is essentially proved. 

In §6 we show how the a,, and b,,, mentioned above, may be computed. The method we 
used is described in sufficient detail to make it possible to extend the list of formulae given 
for {a,} and {6,,}, if required. In §7 various checking systems are discussed which assure us 
that the calculations of § 6 are correct. A special case which we will quote here, and which is 
a consequence of Theorem 0 and the computations in §§ 6 and 7, is as follows: If ~, < oo then 
ast—> +0, 


var N, = 





2 x ,,2 
MoH, , (SM2_ 2s _ Ma 
Oe Gir anh ad) +20 


The asymptotic linearity of the cumulants of N,implies a curious combinatorial identity , 
which we have been unable to prove directly. We discuss this identity in an appendix. If it 
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could be established by a direct and elementary argument, then part of the proof of Theorem 0 
could be drastically simplified. 

Notice that this entire investigation is exclusively concerned with continuous renewal 
processes. Nevertheless, there is a parallel treatment for the discrete process, in which the 
requirement F(.)¢S can (and, of course, must) be dropped. 

The author is grateful to his friend Dennis V. Lindley, who asked the questions which 
provoked the present work. He also wishes to thank Professor J. Neyman for making it 
possible for him to spend the summer of 1957 at Berkeley, where the bulk of this paper was 
prepared. 

2. SOME MOMENT FORMULAE 
Define the rth conventional moment m,(t) = @Nj and write k,(t) for the corresponding 
conventional cumulant of order r. These conventional moments and cumulants are not the 
most suitable for a discussion of N,. Instead, we shall use the moments 


Px(t) = €(N, +1) (N+ 2)... (MN +4) (2-1) 


which come from the generating function 


1 
O(f) =é (1—-g)NH° 


The cumulants 7,(¢) are obtained by a formal power series expansion of the cumulant 
generating function ‘Yj(¢) = log ®,(¢) in the usual way. Thus, the relations between the 
¢@-moments and the yy-cumulants are exactly similar to the corresponding relations between 
the cor ~antional moments m,(t) and the conventional cumulants £,(t). It is evident, from 
(2-1), that ¢,(t) = m,(t) +1, 
Po(t) = m,(t) + 3m,(t) +2, 
Galt) = ms(t) + 6mg(t) + L1my(t) +6, 
y(t) = m,4(t) + 10m,(t) + 35m,(t) + 50m, (t) + 24. 
In fact, it can easily be shown that 
P(t) = |SRE| mMn(t) + [Shea] mna(t) + |Snza] myolt) +--+ [Srl (2-2) 
where S” are Stirling’s numbers of the first kind (Jordan, 1947, p. 142). 
By systematic solution of equations (2-2) one can deduce the reciprocal relations 
my(t) = $,(t)—1, 
malt) = $o(t)—3¢,(t) +1, 
ms(t) = p(t) — 6P2(t) + 74,(t) —1, 
ma(t) = Pq(t) — 10P5(t) + 259,(t) — 15¢,(t) +1. 
However, it is not difficult to deduce from the defining property of the Stirling numbers, G7, 
of the second kind (Jordan, 1947, p. 168) that the general relation is 
m,(t) as Srti¢dnl(t) 7 Cras n-1(t) +00 ( ie a nti (2-3) 
Let us write M(z) = @e*™ for the conventional moment generating function, and 


K,(z) = log M,(z) for the corresponding cumulant generating function. It can be shown that 
Mz) = e-*®,(1 — e-*) and hence that K,(z) = —z+‘¥(1—e-*). Thus we have 


k(t) ¥o(t) 


ky(t)z+—g +... = —2+ 1 () [1-e“]+ 0 —e~}*+.... (2-4) 


I-2 
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A result of Jordan (1947, p. 202) shows that 


Gxt? . > 


l-e Se (- ])mtk 


<<a; (2-5) 





and from (2-4) and (2-5) we deduce the following relations between conventional cumulants 
k,,(t) and the y-cumulants y,,(t). 


k(t) = v(t) -1, } (2:6) 
ken (t) = SRYn (t)—SkYry_a(t) +... +(—1IISL Y(t) (n> 2). 
For reference we list the following: 
k,(t) = ¥.()-n(4), 
kes (t) = g(t) —3y2(t) + vi (4), (2-7) 
key(t) = a(t) — y(t) + T(t) — Yi). 


Finally, to complete our discussion of the relations between the k,,(¢) and the y,,,(t), let us 
aaa (0) = log (1-6) + Ki(—log [1 —). (2:8) 
If we use the following formula of Jordan ((1947), p. 202), 


[log (1 + ¢)]” . sm 


m! oun 


c, 


then we can deduce from (2-8) that 
W(t) = | St] k(t) + |St| k,_y(t) + ... + |S?| h(t) + |S2] [44 (4) — 1). 


Whilst this last formula is occasionally useful for computational checks it will have no 
explicit use in the present paper. 


3. SOME NOTATION AND PRELIMINARY LEMMAS 


All functions with which we shall be concerned will be assumed to vanish identically for 
negative values of their arguments. If Q(¢) is any function of bounded variation in every 
finite interval then we shall write 


*Q(s) = I " e-# dQ(t) 


for the Laplace-Stieltjes transform (L.-S.T.) of Q(t). If Q(t) is any function which is inte- 
grable in every finite interval then we write 


¢ (8) = I e-O(t) dt 
for the Laplace transform (L.T.) of Q(t). The transforms that arise in the present work will 
allexist for Zs > 0. Notice that when Q(t) has botha L.-S.T. anda L.T. then *Q(s) = s,.Q/(s). 

The following lemmas concerning */'(s) undoubtedly include much that is known. How- 
ever, there does not seem to be available a satisfactory and complete treatment, dealing 
specifically with the one-sided Laplace transform, which leads to the somewhat surprising 
Lemma 4, below. For this reason we give the following proofs in some detail. 








——— 


r 
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Lemma 1. If pu, < 0 and 
62(z) = e-* i. e& 2" dz 
0 
then, ass—>0+, 4 68 (x) dF (x) = o(s-). 
o- 


Proof. For any ¢ > 0 we can find an 2,(¢) such that 


E 2"dF(z) <e, 


since , < 00. But O8 (x) < x” [; e-* dz 
< 2/8. 
Hence, a O58 (z) dF(z) < e/s. (3-1) 
Also, for x < 2p, O8 (a) < a. 
and for s < 8 9(2(e), €), xj[1 —e-8*] < €. 
Thus ” @8 (2) dF(z) < e/s. (3-2) 


0— 


The lemma follows from (3-1) and (3-2). 








LEMMA 2. 
azar? —anx)” — 6 n+1 
emer = 1—ax += — dee ( nil +! 2) 0% (x). (3-3) 
Proof. The L.T. of the right-hand side of (3-3) is 
1 2 n n+1 1 
Sige gy Soe 


gvtl “ (st+a)s"t1  s+a" 


i 
Lemma 3. A necessary and sufficient condition for F(x) to have its first n moments finite is 
that, for real s > 0, *F(s) have an expansion 


— e\n 
*F(s) = 1-48 ae ete —— +0(s”). 


Proof. Suppose first that 1, Wg, ..., 4, are finite. Then, by Lemmas 1 and 2 we have 


*F(s) = } * ¢-0d F(z) 





(os) 252 ae — e\nt+l1 
[° 1-serSp-.+$ et any! w o5(e)} AF 


ft 25 En n n 1 
l-p, 18 +5) rt ae | Wi +8 Ho(2). 
This proves the necessity half of the theorem. 

To prove the sufficiency part define the shift operator Z” by the rule L"g(s) = g(s +h), for 


any function g(s). Then the kth derivative of *F(s) on the right is given by 


h_}\k 
*F+(3) = Lt (=) * F'(s). 
h=0+ 
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If the expansion of *'(s) announced in the statement of our lemma holds, then for k < n we 








have *PU+(0) = py, < 0. 
Er-1 k fo 
However, *FED(s) = Lt (==) } e~* d F(z), 
h=0+ 0- 
ce) —hz _ k 
= Lt i (- *) ed F(z). 
h=0+ J0- h 
os) eahz 1 k 
Thus My, = Lt I ( ) 2 dF (z) 
n-o+Jo—\ hz 


se . ‘eh-* 
> lim x | zk d F(z), 
h=0+ = Jo- 
where ¢ is chosen so that for all 0 < z < ewe have 1 —e~* > }z. The finiteness of y, (regarded, 
temporarily, purely as a coefficient in the given expansion of * F'(s)) establishes the finiteness 
of - 
I zk d F(z). 


Lemma 4. A necessary and sufficient condition for the distribution function F(x) of a non- 
negative random variable to have its first k moments finite is that there exists another distribution 
function F(x) such that 


*F(s) = 1—pys +528? moe GE (att Et (a) Fol) 





Proof. Obviously, if the above expansion is possible, then Lemma 3 and the fact that 
*Fy)(s) = 1+ 0(1) as s > 0+ prove the finiteness of the first k moments of F(z). 

Now suppose that we are merely given the fact that 1, < 00. We shall assume k > 1 since 
the lemma is trivial if k = 0. If the mean /, is finite then we can define a new distribution 
function 


F(x) = ran {1 —F(z)} dz, 


* 
with L.-8.T. Pty a 2. 
48 
From Lemma 3 we see that 
*F(s) = 1—py, 3+EP ot 1. OE (— 8)* + 0(s*), 
th * ow tat of... 4 fie, 
so that F (8) 2 nu, 8+ai a +H,, ' 8)*—! + 0(3*—1) 


It then follows, also from Lemma 3, that the first (4 — 1) moments of F(x) are finite, and 
that the rth of these is given by y,,,/(7+1),. Notice, moreover, that 


*F(s) = 1—p,8*Fy)(s). 


We can now repeat the process, e.g. define 


Fy (x 71 = |" {1 — Fy(z)} dz, 





an 


by 


Fo 


ne 


—_ 


w 
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and obtain a new distribution function F(z) whose first (4 — 2) moments are finite, and given 
by the expansion 


2 2 2 
*F4(s) = Lag eet gee te (otto), 


For this second ‘derived’ distribution function f,,(x) we have 


Wa ter L. Smite 


*F(s) = 1—p,8 +3 s?*F,(s). 


Evidently, repeated derivations of Fi,)(x), F(y(x), ..., Fy)(x), will prove the lemma. 

Whilst strictly irrelevant to the present discussion, the remark is worth making that 
Lemma 4 is capable of trivial modification to include distributions of unrestricted (i.e. not 
necessarily positive) random variables. A final preparatory result is the following. 


Lemna 5. If Q(x) is any function of bounded (total) variation (B.V.) then 


*QM(s) = o(s-*) as s>0+. 
Proof. (—s)*¥ *Q®(s) = 4 e~8*(saz)* dQ(x). 
o— 


But, as s > 0+, e-**(sx)* + 0, boundedly. This proves the lemma. 


4, THE ASYMPTOTIC FORM OF ¢,,(¢) 
We need first 


Lemna 6. *¢,,(s) = n! {1—*F(s)}™. 
Proof. Since ¢,,(t) is evidently a non-decreasing function of t it is legitimate to consider the 


L.-8.T. *¢,,(s). 
Now ¢,(t) = &(N,+1)(N,+2)...(N,+n) 
we z (k-+1)(k-+2)... (b-+n) {F,(t) —Fyaq(t)}. 
Thus *$q(8) = ¥ (E+ 1) (k+2)... b-+m) {°F [F()} 
= nif1—*F(s)} 3 BY EF") renee, 





k=0 n! 
The lemma follows at once. 
We remark that it is the particularly simple form of the L.-S.T. *¢,,(s) that makes ¢,,(t) so 
much more convenient, for our present study, than the conventional moment m,(¢). 
Provided y,, < 00 we can consider the function 


*K,,(8) _ 





1—*F(s) 
concerning which we have the following three lemmas 
Lemma 7. If F(t)e S and p,,,, < 0 then K,,(t) is of bounded total variation, and 





Mn+ 
K = a 
a>) (n+ 1) fyb 


Proof. The fact that K,,(t) is of bounded total variation follows from the fact that if 
ns, < 00 then the means of both F(t) and F;,)(t) are finite, and from Lemma 6 of Smith 
(1954). The mean cf F,,,(t) is found, from the Taylor expansion of *,(s), to be #,43/("+ 1) My, 
and so, letting s > 0+ in *K,,(s) we deduce that *K,,(0) = K,,(00) has the value announced. 
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Lemna 8. If u,,,, < ©, so that *K,,,,(s) exists, then 





*KA(8) ns Ig _* 1 
p -ank 3 K,(s) —*K,,4,(8)}- (4:1) 
Proof. We know that 


*Fep(s) = 1 Gy Fn) 
n 


But the right-hand side of (4-1) is equal to 


Pn+1 *Fy(8) i= *Kiy(8) a a0) Pn+1 *Fnsv(8) 


(n +1)", |1—*F(s) 1—*F(s) 1—*F(s) | ~ (n+1)2,1—*F(s)" 








The lemma is thus evident. 


Lemna 9. 
1 
* ae * 
$,(s) rir K,(s). 


Proof. Direct computation establishes the lemma. 

So far we have been able to deal exactly and precisely with the functions and coefficients 
which have arisen. If we were to attack in this way the theorems which we now approach we 
would rapidly become involved in hopeless complication. Our primary objective in this 
section is merely to establish that ¢,(¢) has a polynomial form with a remainder term of 
a certain type. At this stage we shall therefore introduce, and make considerable use of, 
certain notations which will preserve the essence of the various relations in which we have 
interest, without preserving a great deal of undesired and heavy detail. We shall write y for 
any constant, and y,, for any finite rational function of 1, 9, ...,4,. For instance, we would 
replace i, by yz. However, nothirg is to stop us calling 7, by the name yjpo, Or Y;3, if we 
want to. We shall also write * M4 for any multinomial expression in *K,, *Kg, ...,*K,,, with 
coefficients y,, and with the maximum degree of any term not greater than d. We shall also 
insist, when w > 1, that the degree of *K,,, in any term is not to exceed unity. For examples 
of the use of this symbolism we offer the following. 


(i) Mifty*K*Ky + f,*K3 = *Mij, 
(ii) My *K*Ki + We*Ks = *MG. 


Certain points about the notation *M¢ should be noticed. The multinomial terms in *M% 
do not necessarily have to be of homogeneous degree. A *K or y with maximum allowable 
suffix does not necessarily have to occur. The essential feature of the notation * M4 is that if 
/11 < © then it represents the L.-S.T. of a function of B.V. This is because any y,, is 
certainly defined and finite if w,,,, < 00, every *K,(s) with r < w will be (by Lemma 7) the 
L.-S.T. of a function of B.V., and the product of a finite number of L.-8.T.’s of functions of 
B.V. is itself the L.-S.T. of a function of B.V. Incidentally, it is easy to see from Lemma 7 
that M4@( +00), which is the same thing as *M4(0), the total net variation of M4(t), is simply 
Yw+t 

Expressions such as y3, *Mj, etc., may occur several times in the same equation; but it 
must not be supposed that at each appearance they represent the same function. However, 





ess 











Watrer L. SmitH 9 


the following laws of combination should be noticed. If r = max (p,q) and d = max (b,c), 


then 
Yo tVq =r (C1) 
YoVa = Yrs (C2) 
*M3 +*Me = *Mi, (C3) 


*M?*Me = * Mote if =q+1 
p ~“q #1 p=q \ (C4) 


= *°+ otherwise. 


The slight complication in rule (C4) arises from the fact that in a multinomial *M¢% with 
w > 1,a*K,, may not have a higher degree than unity in any term. When we multiply two 
multinomials, of the same weight w, it is possible for a term containing a factor *K2, to arise. 
It should be clear that we may consistently write 


“mS = Vw: 
Lemma 10. If d > 1, then 


* Ida 
M*, “3 Vw * ya 
8 saad 8 a w+l1° 


Proof. A typical term in *M{, could be written as y,,*K,,*K,, ...*K»,, wherer < dand 
every p; < w. This term could be written, alternatively, as *K,, *M@-*. But Lemma 8 states, 
essentially, that *K 


a Vort * 1 
8 aed 8 + My +1 


Thus, remembering that p, < w, we have by (C4) that 


From this symbolic reduction of a typical term in *M4@ it is thus apparent that 





* ya *ya-1 
; <= wet “MS... (4-2) 


If d = 1 then the lemma is proved, since *M°, = y,,. If not, we re-apply the above argu- 
ment to *M4-!, and deduce 








* fd-1 * a-2 
= Yo + Mor (4-3) 


On combining (4-2) and (4-3), and using (C2) and (C3), we have 








* M4 * Mea-2 * Ma-2 : 
8 w= Vw+t 5 + *Me + *Mé., = Vw41 “ + “Me. ° (4-4) 





If d = 2 the lemma is proved at this stage, and it should now be clear that repeated 
reductions will eventually prove the lemma, whatever the value of d. 

In our discussions of remainder terms we shall find it convenient to use the following 
classes of functions, which we now define. All functions, as has been stated before, are 
assumed to vanish for negative argument. 
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Derinition 1. The function A(t) belongs to the class F if and only if it is B.V., tends to 

zero as t approaches +00, and satisfies the condition 
A(t) —A(t—a) = o(t-), (*) 

as t > +00, for every « > 0. 

DerinitIon 2. The function A(t) belongs to the class #if and only if A(t)/(1+4) belongs 
to L,. 

It will be convenient to write 2 = Zn £ for the class of all those functions in both # and 
£. An easy result which we use later is 


If A,(tj)eBW and A,(t)eZ, then A,(t)A,(t)eZ. (C5) 


(In fact Z is a commutative algebra over the reals and (C5) is included in the remark that 
& is an ideal in 2. However, these concepts will find no application in the present work.) 


Lemma 11. Ify,,< 0, w> 1, then 

(i) M4 (t) = o(t) ast > «, 

(ii) whenever G(t) is B.V., the function P(t) whose L.-S.T. is *G* M4 satisfies the conditions 

P(t)—P(t—a)=o0(1) as t+>o, forevery a>0. (**) 

Proof. Terms in *M4% may contain *K,,, to at most the first power so that we can evidently 
write *M@ as *K,,*J+*L, where *J and *L contain only *K, terms with p < w. Since 
My < ©, it follows that J(#) and L(t) are both functions of B.V. Moreover, if we write 
*P = *J{1—*F,,)} then Y(t) is also a function of B.V. and is, indeed, one which vanishes at 
+00 (since *(0+) is obviously zero). Rewriting *M¢% as *L + *¥'*¢, we see that 


t 
M4(t) = L(t) + I W(t-1’) dd,(t’), 


and the fact that M@4%(t) = o(t) now follows from Lemma 1 of Smith (1955). 
To prove the second part of the lemma we notice that the L.-S.T. of P(t)— P(t—«) is 
simply 


aioe el 
1—*F 
which we recognize, by Lemma 6 of Smith (1954), to be the L.-S.T. of a function of B.V. 
Evidently this function approaches zero ast - +00, as may be seen by letting s > 0+. Thus 
the lemma is proved. 


Gy, 





{1 —e-29} *@* M4 = (1c) *G *L, + 


Lemma 12. For any non-negative integer p, define *g,(s) = s-? * M4. Then, if Uy. < ©, 
w > 1, wecan find a y,,,, such that t-?g,(t) —Y».1 belongs to Z. 

Proof. Evidently ‘ 
ay(t) = | 2 aaree), 
where M@ is B.V. Hence ; 


Gp(t) _ a f (sy 
ao = Malt) +" (3) dM4(2). 


This suggests that we take for the y,,.,, referred to in the enunciation the value M4{ + 00). 
Since Mi(t) is B.V. we shall have proved that t-?g,,(t) — M@( +00) is B.V., and 0(1) at +00, if 
we can prove that 1 


L(t) == [ zd V(z) 


Jo 


is B.V. and vanishes at +00, for every integer r > 0, and every distribution function V(z). 
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Choose ¢€ > 0, and take 7; so that V(7,) > 1—e. Then for all ¢ > 7, > e—! 7, it is clear that 


17% t 
iit) < 1 | 2rd V (2) + dV(2) 
T3 0 7; 

< é"+6. 


Thus /,(t) does in fact vanish at +00. Moreover, an integration by parts will quickly verify 
that t1,(2) 
L(t) = Vit) -r| dz. 
. 8 


But, because 1,(¢) is non-negative, this displays 1,(t) to be the difference between two in- 
creasing functions which must, since V(t) < 1, be bounded. Hence 1,(t) is B.V. 

To finish the proof we must show that the condition (*) used in Definition 1 is satisfied by 
t-?g,,(t). To this end we remark that an easy deduction from Lemma 10 is that 


*Mi, — Mi(+0)  *Miw 
oe ° = 





t eh 
Hence 10) _ ya( +co) = { (. -*)’ dM2Z,,,(z), (4:5) 
0 


where M%,,,(z) cannot be assumed to be B.V. However, let us define 


m(t) = [( 1 -\" dM4,,,(2). (4-6) 


We claim that the proof will be complete if we prove that m/(t) satisfies the condition 
m(t)—m(t—a) =o0(1) as t+ +0, for every «> 0. (**) 


For, by (4:5) and the first part of this proof, we have already shown that m(t) = o(¢) as 
t+ +00. Thus {1 —¢/(¢—«)} m(t— a) = o(1), and so, if (**) holds then (*) is satisfied by m(t)/t 
(which is the result required). 

To reduce our problem yet further we can now see from (4-6) that all we need prove is that 
if, for any r > 0, we define 

t 
n,(t) = ral 2d M%,.1(2), 

then n,(t) satisfies (**). , 

An integration by parts (identical with one performed already in this proof) shows that 





0 z 


n,(t) 7 ['n,(z), _ Misr(t) ‘ 
+; | dz = SH (4-7) 
Lemma 11 (i) has proved that the right-hand side of (4-7) tends to zero as t > +00, and so we 
can deduce from the integral version of Mercer’s theorem (Paley & Wiener (1934) p. 58) that 
n,(t) = o(t) ast > +00. Hence 
_ [* m-(2) 
lim ——— dz = 0. (4:8) 
t=+oJi-«. 2% 

Multiply (4-7) by ¢. Then the fact that n,(t) satisfies (**) follows from the resulting equation, 
(4:8), and the result that 4%, ,(t) satisfies (**), which was proved in Lemma 11 (ii). 
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THEOREM 1. If ,,, < 0 then 


Pn(t) = Vil + Yat” 2+... +Ynt t+ Yn toll), 
where w(t)e BZ. 


Proof. By Lemma 6 
*bn(s) = n! [*P,(s)]” 
1 


= nl [2+ *K , by Lemma 9, 








(It is to be recalled that the rule excluding powers of *K,, greater than unity in *M% does 
not apply when w = 1.) 
Let us now apply Lemma 10 repeatedly. We deduce that 





* Yf2 
*d,(8) = a + wee + : 


* n 
aitae t+ M3, 








= etc., 
= Fy Me Tt eM, (4-9) 


Thus it follows that 
dylt) = Vil + ot? 1+... +V,t+ MRib). 


The property claimed for the remainder w(t) follows immediately from Lemma 12, in which 
we let p = 0. 
Lemma 13. If Un.) < 00, > 0, p > 0, then 
* F'@) 
Lp 


is the L.-S.T'. of a distribution function F'?\(x), say, whose first n moments are finite. 
Proof. Evidently 


(- 


(—1)? *F0(s) = [ seg (2), 


and so, if we put . 
_ x? dF (x) 


Pp 


A F'P\(x) 
the lemma is obvious. 


THEOREM 2. If fyini3< 0, n>O0, p> O, then 
Pnlt) = Yyl™ + Yat? +. + Yn t oS , 
where A(the BZ. 

Remark. This theorem bears a close superficial resemblance to the previous theorem, but 
provides us with much more information about the asymptotic behaviour of the remainder 
term, and requires a somewhat more intricate proof. We need the extra information con- 
cerning the remainder term if we are to discuss the asymptotic behaviour of the cumulants, 


which involve products of moments. 
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Proof. The proof is based on the fact that (— 1)? ,¢@(s) is the L.T. of t?¢,,(t). However, 
before we enter the main part of this proof we shall establish the preliminary result 











% 4 Pe Yns1, (1 
(-1) 620) = Sant past tent o(;) : (4:10) 
To prove this preliminary result, we observe that Lemma 10 leads easily to 
* Yr 
— = yo +Yniat Yui? t «+> +Vnppe? * +a? MG... (4-11) 


However, Lemma 5 and some repeated differentiation will demonstrate that 


so that we can deduce from (4-11) the fact that 


* n 
(-5)’ M* f Yost +o(=) 5 (4:12) 


8 7 gptl 








The preliminary result (4-10) then follows at once from (4-9) and (4-12). 
Turning now to the main part of the proof we remark that by Lemma 6 we can write 


n! i sd 
+Pn(8) = < | er.) , 
so that (— 1)” ,.¢(s) is the sum of a number of terms like 


r * FOD(s)...*F9r(s) 
SY rr rr og 

1 Al] —*F (8) 
In such a term, I’, the number of factors in the numerator is 7, which is also the increase 
above n of the power of {1 — *F(s)} in the denominator. The multiplier y will depend only on 
n, and not on the moments //;, 49, ... etc. Furthermore, one must have 


Jitjot-.-+j, +t = p, 
so that r+t<p, 


and max); < p—r—é+l. 
i 


To substantiate these claims, consider what happens if T is differentiated once with respect 
to s. We obtain a number of terms: 

(a) one by increasing ¢ by 1; 

(6) r terms by increasing each j; by 1, in turn; 

(c) one term by increasing r by 1 in the denominator and adding a factor *F™ to the 
numerator. 
It should now be evident that an inductive argument will prove the correctness of our asser- 
tions concerning I’. 

We shall next rewrite I’, using Lemmas 4, 6 and 13, in the form 


D = Yp* FU * Pa... SPUNK yy Patri: 
This equation can be written, more simply, as 


P= Yp *G(s) +Pnirip 
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where G is a distribution function whose first 
(n+-p+1)—(p—r—t+1)=n+r+t 


moments are finite and representable as y,,,,,,. A consequence of this is that, whenever 
p<n+r+t, we can use Lemma 4 to infer that 


*G(s) aie 1 4 Yntp+1 + eps 


getl seri t 3P +Yn+p+i +p) (s). 





If we couple this last observation with (4-9), in which v is to be replaced by n+r-+t#, then 
we can speedily deduce from (4-13) the representation 





Yntp+i1 , Yntp+1 Yotpes 
‘s rte t gntrtt 7s 82 +,4Q, 


where , © is to represent the L.T. of a function of B.V. But Tis a typical term in the expres- 
sion for (— 1)” ,#{?(s), and hence we can infer that 


(—1)? . f(s) = Taccpet 4 Tate ln “pat Q, (4:14) 





where ,© continues to represent the L.T. of some (different) function of B.V. 
At this stage we invoke the preliminary result (4-10) to infer that many of the coefficients 
in the expansion (4-14) must vanish identically, and that 





Y Y 
(—1) 626) = raat gett th +2. 
t 
Thus Pylt) = Yul" + yet 1+... + nat . (4:15) 


Moreover, since Q(t) is B.V., it tends to a limit Q( +00) as t > +00. Thus s,.Q(s) > Q( +0) 
as s>0+. But we must have s,0(s) = 0(1), for (4:14) to agree with (4:10). Hence 
Q( +00) = 0; and since the remainder term ¢-? Q(t) must be bounded (by Theorem 1), we can 
rewrite this remainder term as A(t)/(1+¢)?, where A(t) is of B.V. and vanishes at +00. 

We shall next prove: (a) that A(t) satisfies (*) and hence belongs to #; (6) that A(t) belongs 
to #, and hence to &. It will plainly be enough to prove (a) and (6) for Q(t) instead of A(t). 
Let us, temporarily, assume that we are given only that y,,,, < oo and not the full informa- 
tion /n4)41 < 0. Then the argument that led to (4-14) is still possible, but we can no longer 
assume {2 to be B.V. However, reference to the argument following (4-13) shows that , Q is 
the sum of terms of the forms 


(i) Ynip+ +p) (ep <n+r+t), 

(i) ,@*Mntrtt (r+t <p). 
All terms of type (i) are L.T.’s of functions of B.V. and must automatically satisfy (**). By 
Lemma 11 (ii) the terms of type (ii) are also L.T.’s of functions which satisfy (**). Thus Q 
satisfies (**). In other words we have shown that tf #,,41 < 00 then we may write 


A(t 
Pnl(t) = Yl + Volt + FY nt pos , (4-16) 








is 
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where A(t) satisfies (**). If we compare (4:15) with (4-16) we deduce that Q(t) = A(é)/E. 
a er Q(t) — Q(t-a) = es -% at—2), 

and the demonstration that Q(t) satisfies (*) follows from the facts that A(¢) satisfies (**) and 
that Q(f) vanishes at +00. This proves (a). 

To prove (6) let us suppose temporarily that we are given that p,,,,,. < 00. Consider 
terms of type (i). The distribution function G involved in a typical term was shown above to 
have its first n+r+¢ moments finite, when y,,,,; < 0. We are now assuming that 
L-n+p+2 < 0, and so we can take it that G has its first n +r +¢+ 1 moments finite. Hence, the 
first moment of G;,) will be finite, and representable as y,,,.,,». By Lemma 4 we can therefore 
infer that terms of type (i) can always be written as 


Vn+ : 
= — + Yntp+2 *Gip+1(8)- (4: 17) 


In addition, terms of type (ii) can, by Lemma 10 and the finiteness of ,, ,,,, be written as 


* 
Maye G(s) ve *G(s) *Yntp (s), 


n+p+l 
and thence as Pont + Ynsp+e *Giy(s) + *G(s) *MRTP+1(s). (4-18) 


If we combine the new expressions (4-17) and (4-18) of all terms of types (i) and (ii) then it 
is evident that ,Q can be expressed in the form 


Vn+p+2 ode *E(s), 


where E(t) is some function of B.V. But a (necessary and) sufficient condition for a function 
to belong to L,(0,00) is that its L.T. be recognizable as the L.-8.T. of a function of B.V. 
Hence Q(t) — Yn+p+42 belongs to L,. But Q(t) vanishes at +00. Thus Q(t) belongs to L,. What 
we have hereby succeeded in proving may now be stated as follows: tf 4,54, < 00 then 

II (t) 


Pull) = Vil" + Yat" +... FY nit pa? (4-19) 


where I1(t)e L,. If we compare (4-19) with (4:15) we deduce that IT(#) = Q(é)/t. From this 
equation the proof of (b) is apparent. This brings to an end the proof of Theorem 2. 

We have now proved the required polynomial approximations to the ¢-moments, and are 
ready to turn, in the next section, to the study of the y-cumulants. Before proceeding, 
however, let us see what can be said about ¢,,(¢) if ~,,, = 00. In particular, suppose we are 
only given that 4,,, < 00, q < n. Then, as in the proof of Theorem 1, we can at least get as 











far as «Ma 
i Ya we 
*P,(8) ix gn tgn-it + Tonal gra +... + "M7. 


The following is then an easy deduction from Lemma 12. 
Coroiuary 1. If fig,,< 0, g>O0, then 


Pylt) = Yl” + yet? 1 + 20. HV gg bt? 24+ (1 +8)" 2A), 
where A(t)e ZB. 
Our results would have greater symmetry if we were able to replace Z by Z@ in Corollary 1, 
but we have been unable to prove that this replacement is allowable. 
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5. ASYMPTOTIC BEHAVIOUR OF THE. y-CUMULANTS 


THEOREM 3. If fins n41 < ©, p > 0, then 
V(t) = Ynt+ A 
n me Yn+1 (1 +t)P’ 


where A(t)e BZ. 
Proof. y,(t) is a linear combination, with numerical weights, of a finite number of terms 


lik 
° $y) Ppall) + Bp, (t) 
where p,+.+...+p, =”. By Theorem 2 we have 
t) = yy Pit yotPi- Api) __ 
Pp) my yes + Yo) +o. + Y pitt + (1 +t)"+P-2j ’ 
where A,,(t)« 2. Hence 
Pp, (t) Spall) --- Ppp(t) = Vil" + Yat" +--+ Yn + RO), 
where R(t) is the sum of a finite number of terms of the form 
A, (t) A,(t) A, (t) 


(1 eynteh * (1p aye * pee’ 


t™ 





with m+1,+1,+...+1, <n. By property (C5) of the class @, this form can be rewritten 


A(t) tm ‘ 
(1+t)? \a + t)sn-+e—D p-Eh;|? 





where A(t)e Z. But we must have sn+(s—1)p—X1; > m, so the function in the braces is 
clearly in the class Z. A second appeal to (C5) allows us to write 


A(t) 


MO Tey 


for some A(t)« Z. Combining all such remainder terms we discover that 


A(t) 
(1+t)P 


The theorem will be proved if we can show that the coefficients 7, Yo, ..., Y,—; in the right- 
hand side of (5-1) all vanish. These coefficients depend on the first n — 1 moments /1,, /Mg,.--, M/n—1 
of F(x) and on no other moments. It might be possible to follow through the algebra of their 
derivation and then to show that they automatically vanish, but the algebra involved seems 
prohibitive (although we return to this topic in the appendix). For the present proof we 
adopt a different attack. 

Let F,_, be the space of all distribution functions of non-negative random variables 
whose first (.—1) moments are finite, and let Y,_, be the Euclidean space of (n—1) 
dimensions. Then we can map F,_, into %,_, by letting Fe. F,_, map into the point 
[t= (My, He, «+s ’n—1) Whose co-ordinates are the first (x — 1) moments, in the correct order, of 
F. Call this mapping 7,,_, so that 7,,_, 7 = yw. Then we wish to show that the rational func- 
tions Y,, Ye, «+> Yn—1 Of (My, Me, «++» /n—1) Vanish throughout 7,,_,F,_,. It will be sufficient if 
we can find an (n—1)-sphere S,,,_,) <¢ 7),_;F%,_; and show that these rational functions 
vanish throughout S,,,_,. Let Y,,_, be the class of F(x) which can be written 





Yn(t) = yt" + Yet 1+... +Ynat (Ae &). (5-1) 





1 / f 
Tih gett ..ete-n-1} (x > 0), 
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where 14, V2, ..., Vp_, are real and positive. We show below that 7;,_, Y,,_, contains an S,,,_}). 

Thus it will, in fact, be sufficient to prove that 7,, 72, ...,Y,—; vanish whenever Fe G,,_,. 
To prove that 7,,_,4,_, contains an S,,,_,,) we remark that if Fe Y,,_, then the {y,} are 

given as elementary functions of ,, V9, ..., V__1: 


r! 
My = Ge yit et + Ma} fe = 18. nc) 


It is simple to show that there is a point (,, v, ...,V,_,) in a spherical neighbourhood of 
which the Jacobian Mii flip ---sPhat) 

O(V4, Vay --+> Vn—s) 
does not vanish. Thus there is a point (/11, Mo, ..., 4,1), @ Spherical neighbourhood of which 
is in 7,1, 9-1: 

Suppose Fe Y,,_, and generates a renewal process X,, Xp, ..., in the usual way. Let us 
suppose Vv, < y,, all 7, and write F¥(z) = 1—e-*, 
Then we can uniquely determine a renewal process X, X3, ... by demanding F*(X?) = F(X;), 
alli. By the construction of F# we see that X? < X,, all i, and hence, if we employ obvious 
extensions of our notation, Nf? > N,. This last ieee implies 43(t) > ¢,,(t) for all n, and 
so the generating function ©,(¢) is undoubtedly analytic in any circle C, = {€:|¢| < 6} 
within which ®7(£) is analytic. But a routine calculation shows that 


OF (C) = exp {ét/r(1 0 o)} 








(1—¢) 
which is analytic in C,. Thus ®,(f) is analytic in C,. We use this fact presently. 
If Fe G,,_, then 4 1 7-1 | 
Fe) => 2 tae (5-2) 


Let s = o+i%7 with o, 7 real. Then it is evident from (5-2) that *F(c) is real and strictly 
decreasing in J = [0, +00), and that if oeJ and7 + 0 then |*F(s)| < *F(c). Thus the (n—1) 
zeros of *F(s)—1 must consist of one zero at s = 0 and (n—2) zeros in the open half-plane 
o <0. Furthermore, all these (n—1) zeros must be located at regular points of *F(s), 
although some may be located at zeros of *F’(s) so that the possibility of multiple zeros 
cannot be ruled out. Now consider the equation 


*F(s) =1- (5:3) 


where ¢ is complex, and confined to some small neighbourhood, C,, of the origin. Then it 
follows from the previous discussion of this paragraph, and from the theory of implicit 
functions (Goursat (1933), vol. 1, p. 287) that (5-3) has (n—1) roots z,(f), 2o(€), .--, Zn—a(¢) 
which are continuous functions of ¢. With no loss of generality we can take it that z,(0) = 0. 
Then, if ¢, d are sufficiently small, we shall have z,(¢), z(€), ..., Z,-1(¢) confined to the open 
half-plane o < — 26, |z,({)| < 6, whenever fe C,. mh because of the possibility of 
multiple zeros of *F'(s) — 1 we cannot be sure that z,(f), z3(f), ..., Z,-1(¢) always have distinct 
values unless we restrict ¢ to an annulus A, = {¢: fe < |¢| < é}. 

It will be convenient to write *F(s) = Q(s)/P(s), where Q(s) is a polynomial of degree 
(n—2), P(s) a polynomial of degree (n— 1). This is legitimate, by (5-2). If we write 


10) = |e O(C)at 
0 


Biom. 46 
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then Lemma 6 leads to the conclusion 
+0,(0) = 1-1 -*F() 374 
_1__ P(s)-Qs) 
8 (1—{) P(s) —Q(s)" 


Apart from the factor s, the polynomial in the denominator of (5-4) evidently vanishes at 
21(£), 2o(f), ---» 2,—1(¢). Bearing in mind that z,(0) = 0, some elementary manipulation shows 
that (5-4) may be replaced by 





(5-4) 


1 








rT [s—2,(0)] 
0.) = - (5:5) 
[s—2,(6)] 
i=1 
Thus we may adopt a partial fraction expansion 
= eS BA) : 
«®,(f) 8 Py 8—2z,(f)’ (5 6) 
— TH [z(6)—-2(0)) 
4) = 51 ———_ (G=1,2,...0-1). (5:7) 
I (e020) 
ia 


Since, for €¢ A,, the z,(€) are distinct-valued continuous functions of ¢ it follows from (5-7) 

that the Z,(¢) are finite-valued, continuous functions of €¢ A,. Thus we can find a bound 

M < © such that |z,(f)| < M for all j, uniformly in ¢ A,. Moreover, it is apparent that 

Z,(€) cannot vanish in A, for this would require that one of the factors in the numerator of 

(5-7) vanishes in A,. But if €¢ A, then |z,(¢)| < 6, and |z,(0)| > 26 for all j + 1. Thus Z,(¢) 

cannot vanish in A, and so we can find a bound m > 0 such that |Z,({)| > m for all fe A.. 
We next invert the L.T. (5-6) and obtain 


n—-1 
(0) = ¥ A()e. (58) 


If we suppose Ce A, and use the results of the preceding paragraph then (5-8) can be rewritten 
(6) = Z,(f) es {1 + 8,(€, t)}, 
where S,(¢, ¢) = 0(e-*) uniformly in ¢. If we take logarithms we have 
(6) “a tz,(¢) > log Z,(6) + S,(¢, t), (5-9) 


where S,(¢, t) is also 0(e-*) uniformly in €e A,. 
We have shown earlier that ©,() is analytic in C, and it is plain from the definition of 
,(¢) that ©,(0) = 1. Thus, in some C,, ‘’,(¢) is an analytic function of ¢. Hence 


! ¥, 
Vill) =a ead, 


where C’ = C;,. If we now make use of (5-9) we can obtain the result 


y(t) =a,t +B + O(e~**), 
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_ 2 %($) ! 
where n= oF ott df, (5-11) 
_ ni log Z,(¢) oe 
Bn = ani? eur (5-12) 


A comparison of (5-1) and (5-10) shows that the rational functions 7,, 79, ..+)Yn-1 
undoubtedly vanish when Fe Y,,_,. This proves the theorem. 


THEOREM 4. If w,,,, < 00 then 
Y(t) cd Ynt +Yn4it A(t), 
where A(t)eB. 
Proof. This theorem is proved by the same argument as Theorem 4, with the difference 
that we must now appeal to Corollary 1 to deal with ¢,,(t). 
One can also deduce from Corollary 1 the following 


Corotuary 2. If u,, < 00 then 


Vrlt) ap Ynt + (1 — t) A(t), 
where A(t)e ZB. 


6. THE FORMAL CALCULATIONS 


Our position is that we have shown that under certain conditions y,,(¢) = «,,t+/,+7,(), 
where «, is a rational function of /,, Wg, ..., 4,3 8, is a rational function of /1,, MW, ..., y+, and 
r,(t) is a remainder term tending to zero at +00. We now turn our attention to the formal 
calculation of the rational functions &,,(4, Mo; --+5 fn)» Bn(Mas Mas «+s nar) 

To justify the method we adopt, consider the problem of calculating £,,(/, Ma; ---s /n41) 
defined on Y,,,. If two rational functions on Y,,, are identically equal throughout an 
(n+1)-sphere S,.,)< Y,,, then they must be identically equal throughout Y,,,. But 
T1941 contains an S;,,1). Thus we may suppose, in the calculation of £,,(,, 2, ---» @n+1) 
that Fe Y,,,,. In fact we shall proceed as though F is an arbitrary member of Y = U,, Y,,; if 
we calculate «, and £, accordingly then our results must be correct for all values of n. 

If Fe¥ then: (i) *F(s) is analytic in some open neighbourhood of s = 0; (ii) there is 
a unique analytic function z,(s) defined on this neighbourhood, vanishing at s = 0, and 
satisfying the relation s—1 = *F(z,(s)). This all flows from the discussion in §5. Moreover, 
by Cauchy’s integral and (5-11) we can deduce that if |s| < ?¢ then 


_t 


Imi Po b—8> 


af PRO 


= 5 An gn, (6-1) 
0 


%(8) = 


Uniform convergence justifies the change of position of the integration and summation 
signs. The equation (6-1) suggests that one way of calculating the {a,} is to expand z,(s) as 
a Taylor series at the origin. But we have 

as va ( imag ai Ln 
a ia ony 


n=1 


“4 (8) 
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by the definition of z,(s); in other words we have s as a Taylor series in z,.t Our problem is 
therefore merely one of inverting a series. This process has been discussed by many authors, 
and the fullest computations appear to be those given by Van Orstrand (1910), but one may 
also refer to Adams & Hippisley(1922), Dwight (1957), and Goursat (1933, vol. 1, p. 474). 
If we use Van Orstrand’s results we can obtain the values of «,, listed below. In point of fact 
our values of «,, were calculated independently, by a method which we describe in §7 and 
depends on the correctness of the calculations for /,,,and then compared with Van Orstrand’s 
results. This procedure provided an additional check on our /,, calculations. In quotu.g our 
results we take “4, = 1. We found: 


A, = fla, 


Oy = —fgt 3u3, 


Oy = fly — 10g My + 15y3, 

Os = — fst L5ig 4+ lOu§— 105 p35 + 105y3, 

Og = fg — 2 fly fly — B5 peg [lg + 210 UF Wg + 280M. 13 — 1260p3 15 + 9453, 

Oy = — fly + Wylg Me + 56g Ms — 378 U3 My + BH pq — 1260 pty Mg fUg + 31503 wg — 280 p§ + 63003 5 
— 17,3254 ug + 10,395 p8, 

Og = lg — 36g {lz — 841g Wg + O30 M3 [Ug — 126 p14 15 + 252 lg MyM — 6930 MZ U5 + 1575 pq MG 


+ 2100314 — 34,650/3 15114 + 51,9754 w, — 15,400.03 + 138,6003 02 
— 270,270p8 us + 135,135)23. 


Let us now turn to the more involved problem of calculating £,,. Lemma 4 tells us there is 
a distribution function F,,, such that 


and if, for typographical simplicity, we write 7,,7,, ... for the moments of F,,), then 


*Fiyle) = & AST (6-2) 


r= 


By Lemma 6 and (6-2) we have therefore that 
*$,(8) _ 1 


To 9 ins 
nl ” 1-78+5)8 -...} A 


and the coefficient of s° in the Laurent expansion of the right-hand side of this equation is the 
coefficient of s” in 
T3 


eee 
L+alrys ai® +] + 


n(n +1) (n+2) 
3! 





2 T 3 
rs Tat +... + [re—jter+... +ete., 


which is evidently 


Co, = (-1"'5 ((-1)4n(n41) ... (n+d—1)=* 


THATS 20. Te” 
1 2 v 
Py! Po! « «+ py! (77y!)?2 (71q!)?2 ... (1,1)? | i 
where the inner &* is a summation over all positive integers 7, 79, ..., 7,3 P1, Pg «++» P, Such 
that the 7; are all different, Lp7 = n and Lp = d. 





(6-3) 


{ For a heuristic discussion which shows the present significance of the root z,(s), see Bartlett (1949). 
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Suppose a function Q(t), say, can be written as P(t)+r(t), where P(t) is a polynomial in 
t and r(¢) tends to zero, as ¢ tends to + 00, faster than any power oft. Let us agree to mean by 
‘the constant term in Q(t)’ the coefficient of ¢° in P(t) and by the ‘linear coefficient in Q(t)’ 
let us mean the coefficient of ¢ in P(t). When F< all the moments of F are finite and we can 
therefore speak of the constant term in ¢,(¢), by Theorem 2. But the constant term in ¢,,(t) 
must be the coefficient of s° in the Laurent expansion of *¢,,(s). Thus the constant term in 
¢,,(t)/n! is o,, given in (6-3). 

It is trivial to verify that the constant term in, say, ¢,(¢) ¢,(t) is merely the product of the 
constant term in ¢,(t) and the constant term in ¢,(t), and it is equally trivial to extend this 
result to products of several ¢,,’s and thence to linear combinations of products of several 
¢,,s8. But, by the well-known relation between moments and cumulants (Kendall & Stuart 








(1958)), — d=n i P1 fP2 Py 
Lt aon = te ae * m Tm2*** Fy " 
am 2s (DEE ea a sins 
and so we deduce that #,,, the constant term in y,,(¢), is given by 
ile ook... 2 
“? = — 1)41(d — 1)! &* —*—*_—""}. 6:5 
al ' stein Px! Po! --- p,! (65) 


We shall make use of the customary terminology: weight and degree. For instance, the 
7-product 7$7,73 is of degree 2+ 1+3 = 6 and weight 2x 1+1x3+3x5 = 20. Itis to be 
noticed from (6-3) that @,, is a certain linear combination of all 7-products of weight n. 
Similarly, from (6-5), we see that £, is a certain linear combination of all o-products of 
weight n. Hence #,, is a certain linear combination of all 7-products of weight n, and our 
method of computing /, will involve taking each 7-product of weight n, in turn, and 
determining its coefficient in f,. (It is worth remarking that this is another place where it 
has been to our advantage to be dealing with y-cumulants instead of conventional ones. As 
can be seen, now, from (2-6) the constant term b, in the conventional cumulant &, (t) involves 
all r-products of weight < n.) 

To be specific for a moment, consider a term 7,73 of weight 5 and so occurring in /;. How 
can 7,73 arise from (6-5)? In various ways. We may obtain 7,73 in the expansions of ¢;, 
0104, %2.%3, OF 0,03. Thus, if we represent 7,73 by the multipartite number (1, 2?) the 
various ways in which 7,73 will arise in (6-5) correspond to the various separations (1, 2?), 
(1) (27), (2) (1, 2), (1) (2)?. For each separation we must calculate the individual contribution 
to the coefficient of 7,73 in /;. 

Suppose we now consider a general separation 

IT = Siy Shy ... Stig SH... Sop... SY 
of some general multipartite number S. In this S,,, Sj», ...,S,, are a different multipartite 
numbers of the same weight w,; S,1, Soo, ..., Sx, are b different multipartite numbers of weight 
w,;andsoon. ThentheweightofSisw = wr, + W%o+ ... +W,7,, Where ry = yy +1... +%ie 
etc. This general separation represents one set of ways in which the 7-product 7’ corre- 
sponding to S could arise in (6-5). In fact, the term in (6-5) which is involved is 


CB CS... OG. (6-6) 
If we write r = r;+r,+...+7, then it is evident that the coefficient of (6-6) in (6-5) is 


(—1)1(r-1)! 
er ey , ali 
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Now consider the term o7}, which must give rise to a 7-product corresponding to the separa- 
tion S% Sty ... Siz. By the multinomial theorem this 7-product can arise in 


r,! 


! 


43! Taq! ..- Tag! 


Tia! 
ways. Similarly for the r-products arising from o73,, ..., o73,. Thus the general separation II 
arises from the term (6-6) in 

14! rq! ... Ty! 





(6-8) 


ways. If we combine the coefficient (6-7), which must multiply every 7-product from (6-6), 
with the number of ways (6-8) in which 7’ may arise from (6-6) then we derive the form factor 


(1) (r=) 


143! Tia! -.- Tug 








(6-9) 


Notice that the form factor (6-9) depends only on the general ‘shape’ of the separation II 
and not on the weights of the individual separates. Thus, for example, (1, 2?, 3) (2)? (4) and 
(1) (3)? (7) have the same ‘shape’ which we will denote (-)(-)(-)?. We can thus construct 
a table of form factors which may be used for a variety of different separations. 

The form factor (6-9) is merely the number of ways in which 7 can arise from (6-6), 
multiplied by the number (6-7) which must be a factor of every contribution from (6-6), to 
the final coefficient in £,,. Each separate S;,; in IT will also contribute a numerical factor which 
we now deduce from (6-3). Suppose S;; = (ne m§? ... 7f'), corresponding to the 7-product 


Ty & TE TES... TH 
with W; = Py + Poet... +P)M 
di; = Pyt+Pot... + pp 
Then the coefficient of 7;,; in (6-3) is evidently 
(— 1)”i*4ij w,(w; +1) ... (wze+dy— 1) 








6-10 
Px! Po! «++ Py! (7!) ... (77,!)?» wnt 
ee a _ tg) bctdy=V) 
Pr: Po: +++ Py 
for the separate factor of S;;. Then the numerical factor (6-10) may be rewritten 
— witdi; Cig . 
( “(m (77,!)"2.. . (7, !)ey” (6 11) 
Suppose now that fT = 127%... Te 


is of weight w and degree d. Then when we multiply the numerical factors (6-11) together, 
one for each separate S;;, we plainly must end with 


( Sm. yore =) 1 

(ty!) (tq!) 2... (wy!) 
In the resultant numerical multiplier (6-12) it may be seen that the factor in braces depends 

only on 7' and not on the particular separation II involved. We may call this a 7-factor. 


Thus to determine the coefficient of 7' in £,,,/w! we first determine its 7-factor. Then repre- 
sent 7' by the appropriate multipartite number S and write down every possible separation 





IT ¢;;- (6-12) 








fol 


10) 


11) 


er, 
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of S. For each separation we multiply together the separate factors of each separate, and 
multiply the product by the form factor of the separation. The resulting products for each 
separation of S are then summed, and the total multiplied by the 7-factor of 7’. The result is 
the coefficient of T' in £,,/w!. To convert the result to an expression involving /’s instead of 


7’s we use the result 
Pre 


T, = ; 
7 (r+) ay 





Example. Find the coefficient of 7,73 in /;/5!. 
( ne )o+s 



































(i) The 7-factor is evidently ea =}. 
(ii) S = (1, 2?) and the possible separations of S are 
II, = (1,2); II, = (1, 2) (2); 
II, = (1) (2); M1, = (1) (2). 
We need the following short tables. 
Separate Factor Form Factor 
(1) ] (+) +1 
(2) 2 (*) (-) abe 
(1, 2) 12 iC? +1 
(2?) 10 
(1,22) + 105 











Using the tabulated separate and form factors we can compute the required coefficient as 
follows. 

















Separation Form factor Separation factor Product 
II, +1 105 +105 
Il, 3 1x 10 ~ 0 
II, -1 12x2 — 24 
Il, +1 1x 2? + 4 
Total + 75 














If we multiply the total by the 7-factor } we find that £,/5! involves a term 75 7,73/4. It is 
an easy deduction from this result that £; involves a term 
! 
ree heet 3 125 p19 143, 
(we have taken yu, = 1). 
For this example we have purposely chosen a fairly simple case, but the calculations 
become increasingly tedious as we deal with /’s of higher weights. The chief source of error to 
be guarded against is that some separations of a multipartite number may be overlooked. 
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For instance, the multipartite number (15, 2) referring to the term 3, in £, has 19 different 
separations. 


By the method outlined above we have computed formulae for /,, £,, ..., 8g. We now list 
our results, taking 4, = 1. 


Ay = tha 

Bo = —Flgt+ B/G, 

Bs = Fig — 5ploftyt By, 

By = ~$lst TF oaMa t+ PUG — 44 U5 Uy + 25° u3, 


Bs = $e — 13 pg Ms — Weg ply + 23S uF My + 125 ply Ms — 4653 ug + 25° nu, 
Be = —F lly +E Ma fe + 84 pls fs — 195 UZ os + GS MG — 605 pty fg fly + 12903 1g — 5 


+ 24653 u3 — 57903 uw, + (11,895/4) 8, 
By = Ella — 25 fla fy — $A Mg Mg + B50 lg — TT pty fg + 1295 p1o Wg Ms — 31083 5 +P Wo ni 
+ 10155 Wy — 14,5605 Wy 44 + (76,335/4) u$ 14 — 6230 13 + 48,8603 u3 — 83,2653 nu, 
+ (72,855/2) 43, 
Bg = —Flot Polls + 80flg fly — 584U5 fly + 133/04 Mg — 2520 flo fg Mg + 67133 Mg +282 U5 
— 3626 lg [Ug fs — 235265 Ws + 37,464.15 115 M15 — 54,1383 W5 — 287 0g u§ + (91,315/4) pong 
+ 59,0109 13 4, — 339,990 13 ws 14 + (634,935/2) u3 uw, + (19,040/3) uf — 218,960n3 43 
+ 1,019,970 12 — 1,359,960u8 5 + (8,294,895/16) 8. 


To conclude this section let us remark, what should be fairly obvious, that one can obtain 
the {a,} and {b,,} of Theorem 0, which refers to conventional cumulants, from the {a,} and 
{£,} by means of the relations (2-6) and (2-7). 


7. CHECKS ON THE FORMAL CALCULATIONS 


We begin by describing the way in which we obtained the {c,,} from the {f,} calculations. 
This method is not the best way of determining the {«,,} directly; that developed in § 6, using 
Van Orstrand’s results, is undoubtedly better. But if one has already performed the calcula- 
tions of {f,,} then the present method of deriving the {«,,} is fairly easy. By comparing these 
results with those obtainable by the method of § 6 we have a good check that no separations 
have been overlooked in the {f,,} computations. 

Let w,, be the linear coefficient in ¢,,(t)/n!. Then w,, will be the coefficient of s~' in the 
Laurent expansion of *¢,,(s)/n!. By the same expansion which preceded (6-3) we have 
therefore that 


,=1, 
d=n 


Oni = (—1y" a (—1)4(n+1)(n+2)...(n+d) &* 








TE The... THe ’ 

Py! «++ py! (77y!)?2 ... (71,!)?oJ ° ey 
Thus w,,,, is a linear combination of all r-products of weight n. Notice, furthermore, that an 
individual 7-product of degree d in (7-1) has the same coefficient as it would have in g,,, the 
constant term of ¢,,(t)/n!, except for being multiplied by a ‘correction factor’ (n+d)/n. 

It will be easier to understand the argument that follows if we talk about a specific 
T-product, so let us consider 7,73 (which occurs in «,/6!). Consider, in particular, the separa- 
tion (1, 2) (2) of the associated multipartite number (1, 2?). Corresponding to (1, 2) (2) we 
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have a number of ways in which 7, 73 can arise in (6-4) (with n = 6) in the linear coefficient 
a,/6!. These ways are: 
(i) 7,72 from w, in ¢,(t)/4!, and 7, from o, in ¢,(t)/2!; 

(ii) 7, 7. from o; in ¢,(t)/3!, and 7, from w, in ¢,(t)/3!; 

(iii) 7,7. from o, in ¢,(t)/3!, 7, from o, in ¢,(t)/2!, and the linear coefficient w, = 1 from 
$u(t). 

Let D be the coefficient of 7, 73 in a,/6! and ¢ the contribution of the separation (1, 2) (2) 
towards the coefficient of 7,73 in £;/5!, as described in §6. Then a careful investigation of 
(6-4) shows that (i) contributes an amount (1+%)@ towards Z. The factor (1+) arises as 
the ‘correction factor’ of (1,2). Similarly (ii) contributes an amount (1+4)@ towards %. 

Suppose A is a given ‘shape’ of p parts (e.g. (-) (-)?(-)® and (-)(-)(-)(-)(-)? are ‘shapes’ 
of six parts). Let A have a form factor f. Then the augmented ‘shape’ (-)A has form factor 
— pf. This contention is easily checked by (6-9). 

Now consider the contribution from (iii) towards Z. Since both 7,7, and 7, are here 
behaving as from constant terms (o’s) no correction factor is required for them. But @ is 
based on a form factor of (- ) (-), whereas what is required for (iii) is a form factor of (-) (+) (-). 
By the preceding paragraph we see that (iii) contributes an amount —2¢ to . Hence the 
total contribution to Z by the separation (1, 2) (2) is (+4) @. 

The preceding discussion gives an indication of the general result which we now describe, 
and which can be proved by a careful extension of the argument. Let 7' be a 7-product of 
weight w, and associated multipartite number S. Let StS}... Sf be a separation of S, where 
the separate S; has weight w; and degree d;. Let @ be the contribution from the separation 
Si! S} ... Si to the coefficient of 7 in £,,/w!. Then the contribution of this separation to the 
coefficient of 7’ in a,,,,/(w+ 1)! is 


po ie Toda aS. wa TU &. 


ol “2 
~~ Wy is 


It is this result that enables us to obtain the {«,} rapidly from the {£,,} calculations. 
Example. Find the coefficient of 7,73 in «,/6!. We borrow the results of the example 
worked in § 6. In the computation scheme given below, column A is the extreme right-hand 
column of the computation scheme displayed in the example in § 6; in other words it consists 
of the various contributions to the coefficient of 7, 73 in £;/5!, but with the 7-factor left out. 
In the column B below, we give the appropriate value of the expression in braces in (7-2). 


























Separation A B Product AB 
(1, 2?) +105 3 +63 
(1) (2?) — 10 1+2 —15 
(1, 2) (2) — 24 +4 — 28 
(1) (2)? + 4 1+ + 8 
Total | +28 








The 7-factor, as before, is }. 
Thus the coefficient of 7,73 in «,/6! is } x 28 = 7. 
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Converting to y’s instead of 7’s, and taking 4“, = 1, we see that «, contains a term 


7x6 
ax re Maid = = 280 Wo/3. 


This result will be found to agree with the value of a, given in §6. 

The most obvious check to employ is obtained by putting F(x) = 1—e-*, so that yw, = n! 
for all n. Routine computation shows that in this case y,,(t) = (n!)#+(n—1)!; thus the 
substitution w,, =! in our formulae for «, and /, should give «, = n! and £, = (n—1)!. 
We call this the Poisson check and all our formulae pass it. 

We now derive a useful and wider set of checks. By (5-4) it is evident that 


Phan 
®,(6) = +s —*] —*F(s)—C}’ 


2 0 ‘ ds a 
o nl = te o 8{1 —*F(s)—C}’ 79) 





so that 


iM 


where ( is some circle |s| = 3 in the s-plane. 
Let us suppose, that for some positive integer p, 


(p—1) .,_(P-))(p-2) 5,  (- 


*F(s) = 1—s+ 
(s) 2! 3! p 





(7-4) 


It is true that there is no distribution function F(x) with the above expression for its 
L.-S.T., but we are interested only in formal relations between coefficients so this fact need 
not trouble us. From (7-4) we see that 
1—s)P—1 
1—*F(s) = (t—sP?—1 
and substitution in (7:3) yields 


n nS ie ds 
n! ~ 2mi J go a{(1—s)? —1+ po} 
For ¢ arbitrarily small the contour integral (7-5) has two simple poles within C, at s = 0 and 


ats = 1—(1—p€)"”, where the pth root is meant to be the branch taking the value 1 at ¢ = 0. 
A straightforward evaluation of (7-5) by the usual methods of contour integration then gives 


ong” ¢ a 
nl ~ {1=(1=p)?} (= pop 


Thus Fuk” = log | 372°" | - log €—log {1-—(1 — po)"”} Plog (1-0). 








52 (7-5) 
0 














If we differentiate the last equation with respect to € we obtain the more manageable 
result 





5 Poo _{i—pf}-e- 4 —1) 
1 (n—1)! 1—(1—pgy * 1—pC 
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papell —pO)-o-H + (1 —poy-o-miP +... (1 pO] + P=. (7 


144 








cor 


ind 


If: 





4) 


ts 
d 


id 


es 


le 











Wa ter L. SmitH 27 


The right-hand side of (7-6) is in a form suitable for expansion as a power series in £, and on 
comparing coefficients of €”-1 one deduces that 


gle § —1) mS rt ) (r+ 2p)... (r+n—1p) 7-7 
a? ap =. Pp ‘p) ...(r+n— 1p). (7-7) 


Referring back to (7-4) it appears therefore that our formulae for £,, should give the values 
indicated by (7-7) when we substitute 


y=, My=(P-1), Me = (P- oe (7-8) 


Evidently, by (7-4) we have 


a(£) = 1—(1— pt)? = p+ oA Oe e.... 





If we pick out the coefficient of ¢” in this expansion we can deduce that 


hy, = (p—1)(2p—1)...(n—1p—1). (7-9) 
Thus the substitution (7-8) should also give (7-9). 
We call the checks just described the »-check and all our quoted formulae have passed 
p-checks for 2< p< 8. We presume therefore that they are perfectly correct. 
An advantage of the p-check in the computation of the {f,,} formulae is that the vanishing 


of the y,, for n > p enables one to isolate inevitable errors to a few terms. This makes the 
search for errors easier. 


APPENDIX 
A combinatorial identity 


From Theorem 3 it is possible to deduce a curious combinatorial identity. Let us say that a multipartite 
number S = (p}}, 73, ..., p}*) is allowable if its degree d is not less than its weight w (oneof the {p;} may be 
zero). If S is allowable then associate with it a coefficient 


d! 
(d—w)! (py !)"(p9! )"... (oy!) ‘ 


A separation S} S} ... S%" of S is allowable if every separate S; is allowable. To an allowable separation 
associate a coefficient 





A(S) = 


(—1)*-*(q— 1)! [A(S,)]™ ... LACS) 1 


B(SESY... S%) = —— 
Q1! Wo: «++ Im! 





where g = q,+Go+---+4m: 
Then the identity in question is that 


L# B(SYS%... S%) = 0, (A. 1) 


whenever the summation =# is over all allowable separations of an allowable multipartite number S, of 
degree d, weight w, with d > w+1. 

By choosing S in special ways a large number of interesting special cases may be deduced from (A. 1) but 
we shall not pursue this topic. If we were able to prove (A. 1) by elementary argument we would bein 


t I am indebted to Mr D. A. East of the Statistical Laboratory, University of Cambridge, for the 
calculation of «,, 8, and the performance of all these checks. Incidentally, I am also indebted to him 
for noticing an additional check that no separations of a given multipartite number have been omitted 
in the working. For the form factors summed over all separations of a given multipartite number 
total to zero, except when the number is of the form (7}). This can be checked algebraically, for the 
total involved with a number (7/{', 7§, ...,79¥) is the coefficient of xf: ag: ... x?” in the logarithmic 
expansion of {(1—2,) (l—2,) ... (l—a,)}-. 
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a position to remove the complex-variable argument needed in the proof of Theorem 3. As it is, we deduce 
(A. 1) from Theorem 3. 
To prove (A.1) suppose that 8*d,(8) = eg +e,8+e,87+.... 





* foo] 
“a PAs) = 2, Ags', (A. 2) 
! pe. 
where At = dl =* _ ORO Re + Cay 


(ay! )es... (ar!) Pv” 
and =* has the usual meaning. 

If we invert equation (A. 2) we have 

d4(t) w=d . t¢-wv 

eg at Ae ami te (A. 3) 
where we may assume (by Theorem 2) that the remainder term o,(¢) is negligible. We deduce from (A. 3) 
that the coefficient of ¢” in ¢,(t) is a linear combination of e-products of degree d and weight d—r. It then 
follows easily that the same remark must also apply to y,(t). 

Consider a particular e-product EH = ef°e{:... e3™, of weight w and degree d, with o; > 0 (this is to allow 
some e,; to be absent). Suppose, moreover, that d > w+1, so that the associated multipartite number 
S = (071%... m™) is of the type required for (A. 1) to be true. Then the coefficient of t¢-” in y4(t) must 
contain some multiple of Z. But since d—w > 1, Theorem 3 insists that the coefficient of ¢-” must 
vanish identically. Hence the multiplier of Z must be identically zero. This is, essentially, the proof of 
(A. 1). We must now effect an alternative evaluation of the multiplier, however, to show why this is so. 


Let II = S%S%... SHES... S¥P... SML.. SH 
be a separation of S, with S,; of weight w,; and degree d; for all 7. This separation corresponds to a fac- 
torization of E into E{y E{y ... E7#', where the e-product E£;; isthat associated with S,;. Weare interested in 
the way EZ can appear in y(t). By (A. 3), assuming o,(¢) negligible, it is clear that L,, cannot appear in 
$a,(t) unless S;; is allowable. Thus we must suppose II to be an allowable separation of S, and it is then 
apparent that the factorization L{y ... LY must emerge, in y,(t), from the term 

(=1)™ (q— 1)! 92 Pir... Pi 
G1! Qe! ++» Vu! (dy!) «2. (dy!) 

where Qi = 2,93 and g=2,q;. 

We can obtain Ejy Efy ... Efy from $7 in 





, (A. 4) 


a! 
Qu! M12! «++ Ma! 
ways, each time with a coefficient which is, by (A. 3), simply 
[A(S41)]™ [A(Sj2)] ..- [A(S14)]™*. 
Similar remarks apply to the other batches of factors of E of equal degree. We can then deduce from 
(A. 4) that the contribution to the coefficient of EZ, in ~,(t)/d! which corresponds to the separation II is 
(—1)*(q—1)! [A(S11)]™ ... [A(S x2) 
Gir! Gre! «++ Gia! 
Thus our alternative evaluation of the multiplier of Z in y,(t)/d! is simply £# B(II), and the identity 
(A. 1) is proved. 











= B(Il). 
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A RANDOM WALK IN WHICH THE STEPS 
OCCUR RANDOMLY IN TIME 


By A. MERCER* 
Atomic Weapons Research Establishment, Aldermaston 


anv C. 8. SMITH 
National Coal Board, London 


SUMMARY 


The steps of a one-dimensional random walk are positive and occur randomly in time at 
a fixed mean rate. The sizes of the steps are independent and the size of each step has the 
same given probability distribution. The distribution of the time to reach a fixed barrier is 
obtained and approximations to its moments are derived. The results are extended to the 
case in which the barrier and the random walk process converge at a constant rate. 


1. INTRODUCTION 


The problem considered in this paper arose from the study of the wear of conveyor belting. 
Incidents which damage belting are of various degrees of severity and different types of 
incident occur with different frequencies. From a given distribution of the life of belting, 
information is required about the relative importance of different types of incident. In 
particular, it is desirable to know whether the wear caused by nearly continuous abrasion is 
more or less important than the damage due to the more destructive but less frequent blows. 

The model, which has been used, assumes that damage accumulates until the total reaches 
a certain level, when the belt is considered to be worn out completely. The damage done by 
each incident may be considered as a step of a random walk process in which the steps occur 
at a constant mean rate, and the problem is to relate the distribution of the size of steps to 
the distribution of the time taken to reach a barrier. 


2. TIME TO REACH A FIXED BARRIER 


Consider the one-dimensional random walk process in which the steps are positive and occur 
randomly at mean rate m, but the size of each step, x, is not specified. Suppose that the sizes 
of the steps are independent and the probability density of the step size is f(~). Assume that 
the process starts from the point wu = 0attimet = 0 and let ¢(u, ¢) denote the probability that 
the distance travelled at time ¢ is less than or equal to wu. Then 

Saad 


q(u,t) = e™ z a Pelt), (1) 


where p,(u) is the probability that the distance covered by r steps is less than or equal to wu. 
Therefore, if p(t) is the probability density of the time to reach a barrier at a distance h from 
the initial position, 


Plt) = F,{1— alt} = meme 5 CY 


1 (Pr(h) — Pra(h)} (2) 


* Formerly at the National Coal Board. 
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and the kth moment of the time about time zero is 


or st EN (3) 


But p,(u) = iy Pr-\(x) f(u—x) dx and p,(u) = 1 for u > 0, so that if the Laplace transform 
0 


with respect to x of f(x) is denoted by F(s) and the Laplace transform with respect to u of 
p,(u) is denoted by P,(s), then 


1 
P(s) = Pa(s) F(s) = ... = Pls) {Fy = Foy. (4) 
Therefore the Laplace transform with es to h of the kth moment of the time about time 
zero is ko Ss k! - 

i wa ~{F(s yy = a {1—F(s)}-*. (5) 

Ifa, = x" f(x) dx is assumed to exist for all r, then 

0 
F(s) = in e-* f(x) da = 
0 2 


so that from (5) and (6) as s > 0, the Laplace transforms with respect to h of the first three 
moments of the time about time zero are 


a,( a 
r! 


(6) 





1/1 As 

A ee. BE 

apa Daze * ( I, 

2/1 Ay 3az a, \ 1 

ce PE i 7 
ai larat aes (aa 3a? bli ). (7) 
6 (1 3g 3a; as\ 1 QM, Gd,  5a3\1 

ae ES. os o(1 

wi ata batts * (aed 2a4 at (es a} * Gas) s "hee | } 


But it is well known (for example, Widder, 1946) that if G(s) is the Laplace transform of g(y) 
with respect to y and as s > +0, G(s) ~ As-* where k is non-negative, then under certain 
conditions, g(y) ~ A{I'(k)}-1y*-1 as yoo. Hence equations (7) suggest that as h -> co the 
mean, variance and third moment about the mean are 








l(h . a } 
hee dente poll 

M mile tae t ). 

— ayh 5a; 2a 1 P 

" ai tau 3a? gto(1)/, : (8) 
1 (/3a2 as lla 5a,a, 3a, 

Pema) kc a Seas ons — 1 
Ms (“a <3) b+ 2a$ ae * gas +o(1)}. J 


Alternatively, the (i+ 1)th step may be considered as the ith renewal of a process and then 
a rigorous proof of the asymptotic expressions for the moments can be obtained using results 
in renewal theory (Smith, 1959). 


3. EXAMPLES 


The following three examples illustrate the preceding results. 
(i) Suppose that the size of step has a negative exponential distribution, f(z) = £ e-F*. 


Then 20 B 
= i) Be-s+h2 dz = ———. 
0 B 


+8 
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Also p,(u) can be obtained directly as e-fu 5 ven = 


Pa) 


t)r 
pit) = me—m+ph) > (mty 
r=0 1: rl 

Hence the mean, variance and third moment about 
the barrier are 


# =—(1+ fh), 


_ 21- 


mat + 2hh), 


Hs = (1 +} 


and therefore from (2), 


(bhy 


rl” 


(9) 


the mean of the times taken to reach 


9 (10) 





co ! 
But a, = | faut eP@ dx = wd and substituting in (8) we see that the asymptotic results are 


Bp 


exact. 


(ii) Suppose that the size of step is the sum of two independent variables which are 
identically distributed according to the negative exponential distribution. 


Then 


f(x) = BPue-f and F(s)= 


Also p,(u) can be obtained directly as 





UF) 








me & (Buye 
ae q! 
and therefore from (2) 
(mt) ((Bh)* | (Bh)? 
= me—m+ Bh) 
+ cheats Pie 7 ‘ (2r)! * (Qr-+1)! (1) 
so that as *: > 00, - = fF F+0 (et), 
13 3fh 
... es ct —2fh 
o =aligt pn + O(Bhe ), ! (12) 
7. 5Bh 2], 2 p—2Bh 
t= asliet st tie eae . 
But a, = (r+ 1)!/A" and on substituting in (8) we see that the asymptotic results only differ 


from the exact results by terms containing negative exponentials. 
(iii) Suppose all the steps are of equal size £. Then 2mt has the y?-distribution with 2n 


degrees of freedom where 7 is an integer satisfying n > 


h/— > n—land wz = n/m, o? = n/m? 


and yz = 2n/m%. On substituting a, = £* in (8), we see that the asymptotic values of these 
three moments are 


as) 


a = — LA 
m2 \E* 12)’ 





ne) 


> (13) 
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4. TIME TO REACH A MOVING BARRIER 


Now suppose that the barrier is moving, relative to the random walk process, at a fixed rate A 
per unit time towards the origin. Then at time ¢, the barrier is at a distance (h — At) from the 
origin and the process is certain to have terminated by time h/A. In the application to the life 
of conveyor belting, the relative movement is due to continuous wear of the belting, which 
occurs in addition to the random blows. This wear is the limiting case of that in which very 
small blows occur frequently. Hence, suppose that the steps consist of those whose size has 
probability density f(x) and occur at mean rate m and steps of size x, occurring at mean rate 
m,. Then if f,(x) is the density functior of the step size distribution 


(m+ my) f(a) = mf(x) +m, d(x —2,).* (14) 
Therefore (m+) Y, = ma,+m,2%4, (15) 
where 7, = I ¥ x" f(x) dx 
0 
and a, = r x" f(x) dx 
0 
as previously. Now let m, > o and 2, > 0 so that m,x, > A. Then from (15), 
1 
(m+-m,) 74> ma, (147) (16) 
and (m+m,)y,—> ma, for r> 2, (17) 
may 
= pg 18 
where 71 (18) 


Now the asymptotic values of the mean, variance and third moment about the mean of the 
distribution of the time to reach the barrier when the step-size distribution has density 
function f,(x) are given by replacing a, by y, in (8). Although it has not been proved 
rigorously, these results suggest that if (16), (17) and (18) are then used, the asymptotic 
values of the mean, variance and third moment about the mean when the barrier and 
random walk process converge at a constant rate are, 


_1/ p \?f{h (lt+p\ , a 
emilee) Co) ta 
1 ( p \*{a.h(1+p\ 5a} 2a, (1+p\\ 

Res an _ pons: eae Seal 19 
om malate) (ae (Co) tata p) i 
_ 1/(_p \§{[8a3_ a, (1+p)\] (1+e jp tik _ Saat te) +e) 
Ms mi\i+p) \La at p JV p )°* 2af ag Vp ) Taek p ) 


5. PRACTICAL APPLICATION 














In the previous sections the distribution of the time to reach a barrier has been found. 
Expressions for the moments of that time have been obtained as functions of the mean 
frequency of the steps, the moments of the step-size distribution, the distance of the barrier 
from the origin and the rate at which the barrier and random walk process converge. In 
practice, the moments of the life distribution are known and the problem is to make some 
inference about the discrete blows and continuous wear. 


{* For definition of 6(h) see footnote to p. 68. Ep.]. 
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where € is the size of the discrete blows. Hence p = mé/A is the relative importance of the 
discrete blows to that of the continuous wear. This is the parameter in which one is most 
interested in order to decide whether the surface of the conveyor belting, which is largely 
affected by the continuous abrasion, or the carcase, which has to stand heavy infrequent 
blows, is in greater need of improvement. The exact expressions for the moments are too 
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If the variation in the size of the blows is negligible, then from (19) the asymptotic expres- 
sions for the first three moments are 


> 


(20) 





Table 1. Lxact and asymptotic values of moments 


































p my mo? mE ls 
Exact Asymptotic Exact Asymptotic Exact Asymptotic 
0-5 1-056 1-056 0-102 0-102 — 0-004 — 0-004 
1-0 1-625 1-625 0-370 0-370 0-075 0-070 
2-0 2-229 2-222 0-901 0-938 0-620 0-565 
10-0 2-997 3-140 2-956 2-607 5-455 4-052 
co 3-000 3-500 3-000 3-589 6-000 7-250 
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= $+2, 


ay? = $-2r+z2, 
aay? = 12 — 5a +322 + (3—2)z. 


(%—- 1)", pn = x 


complicated to be used for estimating the parameters of the distribution, but it can be shown 
numerically that convergence is rapid if p is not large. If h/£ is an integer, n say, then it can 
be shown directly that the first three moments about the origin are exactly 


‘ (21) 





ear eat, 


The exact and asymptotic values of the mean, variance and third moment about the mean 
are given in Table 1 for h/£ = 3. It will be seen that the asymptotic value for the variance 
oscillates about the exact value. Now let p= 
denote o?/u? by «, and y,/u* by a. Then the three equations given by the asymptotic 
expressions for the moments are 


y and h/£ = az and 


(22) 





res- 
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Hence estimates of p, m and h/é follow from the solution of 
43202 y4 — 32(15a, + Say) y?-+ 24(2 + 450) y2 — 600 — 29 = 0. (23) 


In the course of our investigation equations (22) and (23) were used to calculate a table of 
values of p, wm and h/é for certain combinations of values of «, and «,. We should be glad to 
make these data available to any reader of this paper who wishes to go further into the 
application of the theory. 

It would be possible to estimate the standard errors of the estimates of x, y and z and 
hence those of p, m and h/£. However, the formulae are too complicated for any assessment 
of the efficiency to be practical but, in any case, the only possible method of estimation 
appears to be that of moments. 


This paper is published by permission of the National Coal Board. 
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A TEST OF HOMOGENEITY FOR ORDERED ALTERNATIVES 


By D. J. BARTHOLOMEW 
University College of North Staffordshire 


1. INTRODUCTION 


A problem which occurs frequently in statistical analysis is that of testing whether a number 
of normal variates have the same mean. Given k such variates with mean values m,, mg,...,m,, 
the null hypothesis which is tested may be written, 

Hy:m, = Me = ... = Mz. 

The object of this paper is to give a new solution to this problem which has many applica- 
tions, especially in the social sciences. The appropriate test of the hypothesis can only be 
determined when the alternative hypotheses, which are considered likely or important, have 
been specified. The most general form of alternative, which is the basis of almost all existing 


work, may be written, H,:m, + mz + ... & ™ 
1° 1 2 eee ke 


As examples we note that the standard analysis of variance tests fall into this category. 
The y?-test for the equality of proportions in a 2 x k contingency table is a further example if 
the numbers involved are large enough. In some applications it is possible to be more 
precise in the specification of the alternative. When this is the case it is advantageous to 
make use of this extra information to obtain more powerful tests. This paper deals with 
what have been called ‘ordered’ alternatives for which the rank order of the means is known. 
Thus instead of H, above, we shall consider 


H,:m, > mz > ... > M. 


At least one of the inequality signs must be a strict inequality so that H, is not included in 
H,. The practical importance of this alternative will be clear from the discussion below. For 
the simple case k = 2 the situation is met by using a single-tail test, but for k > 2 the 
distinction between one- and two-tail tests is lost. The present work may therefore be looked 
upon as a generalization. of the single-tail test. 

Attempts to meet the need for a test against ordered alternatives have already been made. 
Jonckheere (1954) discussed the one-way analysis of variance and gave a distribution-free 
test which is closely related to Kendall’s coefficient of rank correlation. The need for a test 
of this kind arises in psychological work where qualitative characteristics can be ranked but 
not easily measured. Jonckheere mentions, as an example, an experiment to test the effect of 
stress on a task of manual dexterity. Here data would be obtained from groups of subjects 
working under high, medium, low and minimal stress, the null hypothesis being that stress 
has no effect on performance, and the alternative that increasing stress produces an in- 
creasing effect. Many similar examples occur in the analysis of social survey data where 
people are often grouped according to ‘social class’, ‘living conditions’, etc. Such factors 
can seldom be measured satisfactorily but they can be ranked according to their expected 
effect. 

Armitage (1955), who discussed the problem in connexion with the analysis of 2k 
contingency tables, drew his examples from the medical field. He was particularly interested 
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in linear changes in the proportions and gave tests which amount to converting the problem 
to one of regression, by allocating scores to the experimental groups. 

Neither of the approaches to the problem mentioned above provides a general solution, 
since each was designed for a particular application. The new tests to be derived are based on 
the likelihood ratio and are applicable to any problem which can be formulated as a test for 
the equality of normally distributed means. They are closely related to the familiar y? and F 
criteria which are used when the alternative is H,. Significance is easily tested using tabu- 
lated functions or the special tables of percentage points included in the paper. 


2. THE TEST CRITERIA 


2-1. Suppose that we have independent observations 2, 2, ...,%,, Where x; is normally 
distributed with mean m, and standard deviation o; (¢ = 1, 2,...,k). It is important to be 
clear on the meaning of the suffices; thus x, is the observation from the population with the 
largest mean under H, but is not necessarily the largest observation. In this section it will be 
assumed that the o’s are known, but in §2-2 we shall include the case when o; = o/,/n; 
(¢ = 1, 2, ...,k), the n’s being known sample numbers and o being estimated from the data. 

Our problem is to construct a test criterion which is particularly sensitive to the alterna- 
tive H,. Since the x?-test, used when the alternative is H,, can be derived by the likelihood 
ratio principle it seems reasonable to use the same approach when it is H,. Although it 
is not clear, in this case, whether the test derived has optimum properties, the method has 
a strong intuitive appeal and leads to a meaningful test. 

The standard method of deriving likelihood ratio tests leads to the following form of test 


criterion k E k y 
Xi = & a,(7;— 2)? — Ba,(a,—m,)°, (1) 


k k 
where a; = 1/o?, 7= > ani|S a, and My, Mg, ...,M, are the values of m,, mp, ...,m,, Which 
1 1 


maximize (1) subject to the condition m, > mz > ... > M,. The symbol %7 is used because of 
the close link with the usual y?-test which will become apparent in what follows. The effect 
of restricting the alternative to H, is to introduce the second term on the right. The values 
of m4, Mp, ..., mM, Which maximize (1) are those which minimize 


k 
U;,, = Ya,(x;,—m,)’, 
1 


so the problem of determining 77 has been reduced to the following. Minimize U, with 
respect to m4, Mg, ..., mM; Subject to the restriction m, > mz > ... > M,,. 

It will simplify the determination of the minimum of U,, if we use geometrical terminology. 
The first step is to discover whether the absolute minimum of U,, lies in the region H, 
(m, > m, >... > m,). If this is so the restricted and unrestricted problems have the same 
solution, which, in this case, is obviously m; = 2; for i = 1,2,...,k. This solution lies in 
H, if x, >%>..., 2 Zy- 

If this is not the case then it will be possible to find x; < 2;,, for some j. The absolute 
minimum would require m,; < 7;,, which is outside H,. To avoid this we must introduce the 
restriction m;>m,,, before minimizing U,, as follows. 

U,= LY  a,(x,— mj)? + {aj(xj — mj)? + 45,4(2 544-5 41)"} 
i+j,f+1 
=R+S, 





say. 
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The minimum of R is unaffected by the restriction and is therefore zero when m; = 2;. 
Consider now the minimum of S. The point m,; = x;, m;,. = %;,, falls outside the region 
m; > m;,, in the (m;,m,,,) plane. The minimum of S will therefore occur on the boundary 
of the region, that is when m; = m,,,. In this case it is easily shown that 
My = Mj. = ars stg 

o 7 ere 


It will be convenient, for what follows, to introduce the notation 
qa qa 
X(p,q) = XY 4x; ) X 4. 
i=p i=p 


The minimum of U, subject to the restriction m; > m;,, may therefore be written 
thy = yx = X(j,5+1), 
th, = 2; ( + j,j+1). 
The problem has now been reduced to one involving (k—1) variates. If 
Uy > Myr... > Xj_y > X(j,j+1) > Ug F... > UM, 


the final solution has been reached. Otherwise the problem is the same as the original but 
with the number of variates reduced by one. It may therefore be treated in the same way by 
taking X(j jb. j+1) as a single observation with weight (a;+a,;,,). The rule for obtaining 
M1, Mo, ..., M, may, therefore, be stated as follows. 

Arrange the observations in the order predicted by the alternative, thus, 21, 7, ...,7,. If 
any consecutive pair x;, x;,, are not in the expected order (i.e. if ;,, > 2,;), form the average 
X (jG +1) = (Aj Xj + 544% j41)/ (Aj + 4j41)- 

The series is now reduced to (k—1) members of which (k— 2) are unchanged and one is the 
average of two original ones. Proceed exactly as before, treating X(j,j7+ 1) as a single 
observation but with weight (a;+a,,,). Continue in this manner until the resulting values 
are in the order predicted by H,. The following example illustrates the method. 


Example xy Le Ls L, 

60 —73 —141 7 

Gy = Gy = Oy = A. 
We notice that x, > x, so we form their average, 
X(3, 4) = }(—141+7) = —67. 
Now X(3, 4) > 2, so we calculate 
}{2X(3, 4) +a} = X(2,4) = 4(—73—141+7) = —69. 
As x, > X(2, 4) the solution is 
m, = 60, Mm, = ms = mM, = — 69. 


By calculating m,, me, ...,m, in the way described %2 can be obtained by substitution 
n (1). It is easily shown, for estimates of the form given by this method that 


Fa,(2,—%,)* = Fa,(f,— 2). (2) 
1 1 





k 
XE = Da(x,—z)*— 
1 





| but 


y by 
ining 


+ if 


rage 


s the 
ingle 
alues 











D. J. BARTHOLOMEW 39 
The difference between the method of calculation of the usual x? and %? is that for the 
latter we use the estimates ,, Mm, ..., Mm; instead of the original observations 2,,X», ..., Xj. 


This is illustrated by the following example. 


Example a 1 2 3 4 
x; — 0-83 1-88 0-20 0-44 
a; 5 10 10 5 


Carrying out the procedure described above we find 
MM, = Mz = 0°98, ms = M,= 0-28, =F = 0-63. 
Hence X3 = 5(0-98)2 + 10(0-98)? + 10(0-28)2 + 5(0-28)? — 30(0-63)? = 3-68. 


The example also indicates an alternative method of calculation. We could look upon the 
problem as involving two observations, X(1,2) = 0-98, X(3,4) = 0-28 each with weight 
(5+ 10). %3 would then be calculated as the usual y? sum of squares using X (1, 2), X(3, 4) and 
the appropriate weights. This alternative method is always available and is, in fact, the 
simplest method of calculation. When the averaging process is complete we have / means, 


X(1,k,), X(ky+1,k, +k), ...,. X(k—k, +1, k) 
with weights A(1,k,), A(k,+1,k,+k,), ..., A(k—k,+1, hk), 


U 
where A(p, q) bad Sa, >» k; = k. 
Pp 1 


Xz, is then obtained as the sum of squares of these means. This will be referred to as the 
reduced form of the problem. 

2-2. In this section we give the modifications necessary when o can be estimated from the 
data. Consider the problem as it arises in the one-way analysis of variance by groups where 
we have observations 2;;(¢ = 1, 2,...,k; 7 = 1,2,...,,;), which are normally and indepen- 
dently distributed about a mean m; with common standard deviation 7. Define 


a 1 ™ = k a k 
Z,=— Ya and z= Enz,,/¥ Ni» 
= 1 1 


then we have to test whether Z, , Z, , ... %,,. come from populations with the same mean value. 
The mean %;, has standard deviation a/,/n,; and therefore a; = n,/o®. The most obvious 
modification of the test criterion is the replacement of o? by the residual mean square 
obtained from the analysis of variance t ble. If this is denoted by S? the criterion would 
become k 

ps ni(t, — 2, )?/Se. 


However, a slight improvement can be obtained as follows. Suppose, for example, that 
Z;, < %,,,,, then following the rule for calculating the test criterion we form 


X(t, 041) = (M,% + 41% i41.)/ (M+ M41). 


This is exactly equivalent to pooling the ith and (i +1)th groups and then calculating the 
average of the single group so formed. The residual mean square calculated from this new 
table will have one more degree of freedom than that from the original table, because the 
‘between groups’ degrees of freedom have been decreased by one with the total remaining 
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constant. In general, it can be shown that if the reduced form of the problem consists of 
1 groups then the increase in the residual degrees of freedom will be (k —1). The test criterion 
to be used is therefore defined as 


F, = n,(m;—Z_ )?/(l- 1) S?, (3) 


eM 


where S?? is the residual mean square of the analysis of variance table obtained from the 
k _ 

reduced form of the problem, having (N — 1) degrees of freedom (w => ni) f,, is thus the 
1 


ordinary mean square ratio calculated for the reduced problem. An example, illustrating 
the method of calculation, is included in § 5. It can readily be shown that F,, is the criterion 
produced by the likelihood ratio principle. 


3. THE DISTRIBUTION OF X2 AND F,, 

3-1. The distribution of ¥2.. To illustrate the method of approach to the distribution problem 
we consider first the case k = 2. This must, of course, reduce to the familiar one-tail test. We 
have @ 
X= La(x,—-z) for 2x > x, 

1 
=0 for 2, > 2. 


For tests of significance the probability required is 
2 

Pr {Xz > y} = Pr {2 > X_; La,(z,-Z)P > 7| 
1 


2 
when the null hypothesis is true. Now the value of }) a;(~; — %)? does not depend on the order 
1 


of x, and x, but only on their absolute difference so we may write 
2 
Pr {x3 > y} = Pr{z, > x} Pr |S a,(u,—%)? > 7}. 
1 


Further, since on the null hypothesis Pr {7, > 2} = 4 whatever a,, a, we have finally 


Pr {Xz > ¥} = 4 Pr{xi > 7}, 
where y? denotes x? with v degrees of freedom. This will be recognized as the equivalent of 
the one-tail test. 

For larger k the method is similar. Let P(l, k; a1, a, ..., a.) denote the probability that the 
reduced form of the problem consists of / means when the original observations 2,, 2», ..., 2, 
had weights a,, d, ...,@);,. When there is no risk of confusion we shall suppress the a’s and 
write P(l, k). 

The probability integral of ¥2 may thus be written 


k 
Pr{xe > 7} = SPU, b) Pr {Rt > 10; 
Pr {Xi = 0} = P(1,k), 


(4) 


where Pr {X32 > y| 1} is the probability that %? exceeds y, given that it was calculated from 
means. This is simply equal to Pr {y7_, > y} as we now show. 
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An obvious simplification of the notation introduced at the end of § 2-1 gives 


XE = B(x.) 
where X= Z4,X,/S4, and var(X,;)=Ajz! (i=1,2,...,l). 
1 1 
Two conditions must be satisfied if %7, for given 1, is to be distributed like y? with (/—1) 
degrees of freedom. 

(i) Each X;(t = 1, 2,...,1) must be normally distributed about a common mean. 

(ii) The restriction X, > X, >... > X, must be irrelevant as far as the distribution 
of X%7 is concerned. This amounts to showing that the X’s may be treated as if they were 
independent. 

The first condition is satisfied, on the null hypothesis, since the averaging which leads to 
any X, does not depend on the magnitude of the values which are averaged. They can 
therefore be regarded as being selected at random. 

To show that the second condition is also satisfied, consider the following, algebraically 
equivalent, expression for 3. 

1 
Xi = +t A;,A,(X; - X;)? ~ A;. 
If the X’s were independent then (X ;—X,)? would be the square of a normal variate with 
zero mean and ¥z would be a linear function of such variates. When the X’s are ordered, 
(X;—X;,) is distributed like the modulus of a normal variable (since X; > X; when 7 > j). 
However, the square of the modulus has exactly the same distribution as the square of the 
difference when the sign is not restricted. The distribution of 7 is therefore unaffected by 
the dependence among the X’s resulting from the restriction X, > X, >... > X;. 


(4) may therefore be re-written 
@o 


k 
2 = 2 2 
Prig? > 7} = BPE) [ p(xf-a) dx? a 


Pr (x? = 0} = P(1,k). 
The distribution problem thus centres on the determination of the probabilities P(l,k). In 
what follows we give complete results for k = 3 and k = 4, and a partial result for k = 5, 
using known results about the normal multivariate integral. The following notation is used 
2, =2;,—-%4, (¢=1,2,....(4—1)). 

pi; is the product moment correlation coefficient of z; and z;, which is found to be 

a;a; : 

Poo ~ fae ry eS er oe 
pPy=1 for i=), 
=0 for |i-j| > 1. (6) 

k=3 P(3, 3) = Pr {z, > 0,2, > O}. 





On the null hypothesis z, and z, have a normal bivariate distribution with zero means and 
correlation coefficient p,,; hence using the well-known result of Sheppard 


—l _ 
P(3, 3) = : [1— Pa 
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In the special case a, = a, = G3, Py. = —4} and P(3, 3) = 1/3!; a result which could have been 
obtained directly since, in this case, all permutations of the x’s are equally likely. P(2, 3) can 
be obtained using the known results for k = 2. Two possibilities must be considered: 


(i) 4, <2, X(1,2)> 2, 

(ii) <2, X(2,3) < 2. 
Now X(1, 2) is normally distributed with zero mean and variance (a,+a,)—1, so that the 
event x, < x, is independent of the event X(1,2) > x3. Hence the first of these possibilities 
ih cn P(1,25 dy, 43) P(2, 2; (0, + 4g), 4). 
By a similar argument the probability of the second is 

P(1, 2; dg, dg) P(2, 2; a1, (ag +as)). 

Because P(1, 2) = P(2,2) = 4 whatever the weights, 


t P(2,3) =3+} =}. 
Using the fact that } P(l, k) = 1, P(1,3) is found to be 
1 


1 ne 
k=4 P(4, 4) = Pr{z, > 0,2, > 0,25 > O}. 
When 2, 22, 2, are distributed in the trivariate normal form with zero means, David (1953) 
gives the result 
1 
P(4, 4) = io (27 — cos py2— Cos? p23 — COS p,3) 

the p,,;’s being given by (6). 

P(3, 4) is built up, by a similar argument to that used for k = 3, using the results for k = 2 
and 3 as follows: 


P(3, 4) = P(1, 2; a,, ag) P(3, 3; (a, +9), dg, Ay) + P(1, 2; ay, a3) P(3, 3; a1, (A+), M4) 
+P(1, 2; 3, 4) P(3, 3 ; Gx, Ag, (a3 +,)). 


a it a -1,m 
Therefore P(3,4) = s (2 “ oe st) + (1 _e eu) + (1 __ cos es) 
4 7 7 TT 
The correlations, which are given below, prove to be equal to the partial correlations between 


the z’s, as indicated. 
(a, +g) a 
pu = -Je ++ Gg) (a3 +44) hots 








pin = — | “a4 =p 
” (a + G+ Gg) (p+ 43+) - 





pl, = -/ A, (43 + 44) -_ 
ols (a, +4.) (ag+a,+a,) ° 
whence P(3, 4) = }— (cos! pyo.5 + COS! Pyog.1 + COS Py3.9)/477. 


In the same manner the equation for P(2, 4) is found to be 
P(2,4) = P(1, 3; ay, dg, a3) P(2, 2; (a, +2 +45), Ay) + P(1, 3; ag, dg, A) P(2, 2; ay, (4g +43 +) 
+ P(1, 2; a,,a,) P(1, 2; a3, a4) P(2, 2; (a; +2), (43 +,)). 
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Substituting known results in this equation we find 
P(2, 4) = § + [cos pyp + OS™ Pyg]/477 
= 4-—P(4,4). 

Finally, by subtraction 
k P(1, 4) = (cos™ pya.g + COS™ frag. + COS Py3.9)/47 — }. 

>4 

It is not, in general, possible to obtain the distribution for k > 4 because there is no known 
expression for Pr {z, > 0,2, > 0,...,%m, > 0} when m > 3. Some numerical values and methods 
have, however, been given by Plackett (1954) and these may prove useful. For the special, 
but important, case when the u's are all equal, results can be obtained for k = 5. In this case 
all permutations of the x’s are equally probable and so 


Pr (1, > %_ > %3 > % > 5) = P(5, 5) = 1/5! = z4y. 
The probabilities required to obtain P(/, 5) for 1 < 5 are all known so the above methods can 


be used. The resuits obtained are given in Table 1. I have conjectured the following result 


for the general case with equal weights*. It yields the correct values for k < 5. 
k-1 
P(l,k) = ¥ P(i,k-—j) P(l—1,j)/l. 


j=l-1 


The proof is straightforward for / = 2 and/ = k, but breaks down for the intermediate cases. 


Table 1. Values of P(l,k) when the weights are equal 








l 2P(l, 2) | 6P(l, 3) 24P(1, 4) 120P(I, 5) 
1 1 2 6 24 
2 1 3 li 50 
3 —_ 1 6 35 
4 — — 1 10 
5 — — — 1 























3-2. The distribution of F,,. The conditional distribution of F,,, given that there are / means 
in the reduced form of the problem, is simply that of F_,, y_; by the argument of §3-1. The 
probabilities P(/, k) depend only on the correlation coefficients p;; which are independent of 
o*, Therefore 


Ao k 
Pr {f, 2 y} — a Pil, k) Pr {F_1,y-1 2 y}; (7) 


Pr {F;,, = 0} = P(1,k). 
For testing significance it is convenient to transform the F distribution to an incomplete 
B-function giving 
Me: k k 2 
Pr{fi, > y} = y Pi k) (1—L,{4(1— 1), (N —)}) = rPi, k) L,_A(3(N —D), 4(U—1)), (8) 
where z= (l—1)y/(N—-1+(l-1)y). 
* See Note added in proof on p. 48. 
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4. CALCULATION OF PERCENTAGE POINTS 


The results of § 3 give all that is necessary for the calculation of percentage points for the %2 

and F,, statistics. Given the weights @,, ds, ..., a, and tables of the y? integral or incomplete 

B-function, it is simply a matter of substitution in (5) or (8). The purpose of this section is to 

give tables of percentage points to reduce the work involved in testing significance. 
Consider first the distribution of 73. From (5) we have 


Pr {X%3 > y} = ; (1 — he) [Proaae+; [p08 dXi. 
Table 2 gives the values of y satisfying 
Pr {qj > y} = 0-05 
= 0-01, for —p,,. = 0(0-1) 1-0. 
This table will be adequate for most practical work, using rough interpolation if necessary. 


When high accuracy is required it is better to make a direct calculation of the probability 
rather than use interpolation methods. This remark applies also to Table 3. 


Table 2» The 5 and 1% points of X3 























—Pu_| 5% 1% —Priz 5% 1% 
0-0 4-231 7-289 | 0-6 3-715 6-700 
0-1 4-158 7-208 | 0-7 3-593 6-556 
0-2 4-081 7-122 0-8 3°446 6-377 
0-3 4-001 7-030 0-9 3-245 6-130 
0-4 3-914 6-932 1-0 2-706 5-413 
0-5 3-820 6822 | — — a 

| | 








Table 3 gives the 5 and 1% points of ¥% for —p4., — Po, = 0(0-1) 1-0, subject to the 
requirement 
— (1-5) < Piz < J (1 — pis). 


This restriction is simply a consequence of the fact that partial correlations must lie in the 
range (— 1, +1). As the probability integral is symmetrical in p,9, Po, the lower half only of 
the table is printed. Values in the upper half are obtained by interchanging p,,. and po. 

The 5 and 1% points for equal weights when k = 5 are given in Table 4. 

In each case the probabiiity integral was calculated from the distribution function of x? as 
tabulated in Biometrika Tables for Statisticians, and from tables of sin-! x. The percentage 
points were then obtained by inverse interpolation using the second order Bessel formula. 
They were checked by direct calculation using exact expressions for the x? integral. 

Percentage points for the F, distribution have not yet been calculated. Although feasible 
for k = 3a table with 3-way entry would be required for k = 4 and one with 4-way entry for 
k = 5. It is planned to carry out further work on the distribution of F,, to obtain, if possible, 
simple approximations. This would avoid the necessity for extensive tabulations. 
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Table 3. The 5% (upper figure) and 1% (lower figure) points of x2 



































—Piez | 

0-0 0-1 0-2 0-3 0-4 | O85 0-6 0-7 
— Pes 

| | | 
0-0 5-435 he a or dies | = = rae 
8-746 cals oe Hod ~ hla «sale>> ih, a 
0-1 5-372 5-305 ae “ oe -~ a ™ 
8-676 8-600 mee joi ne sake ‘ag om 
0-2 5-307 5-235 | 5-160 = ee hee is 
8-602 8-521 8-436 ~ gageinad fer). re sh 

| 
0-3 5-239 5-162 5-081 4-993 “Ser = ae 
8-525 8-438 8-346 8-247 ati Se = 2a 
0-4 5-167 5-083 4-994 4-898 | 4-791 ak i San 
8-442 8-348 8-247 8-137 8-015 ae pti si 
0-5 5-088 4-997 4-898 4-791 4-670 4523 | — ve 
8-351 8-248 8-137 8-014 7-873 77709 | — mi 
0-6 5-003 4-900 | 4-789 4665 | 4-524 4-354 | 4-135 ~ 
8-250 8-135 | 8-008 7-867 7-708 7-505 | 7-244 -_ 

| 
0-7 4-904 4-787 4-657 4-510 4337 | 4117 | 3-805 3-137 
8-135 8-002 7-854 7-684 7-482 | 7-224 | 6-846 6-001 
| | 

0-8 4-787 4-644 4-484 4-294 4-056 | 3-715 | 2-706 ae 
7-994 7-831 7-647 7-427 7-147 | 6-734 5-413 ae 
0-9 4-631 4-432 | 4-196 3-883 — <p _ 
7-804 7-579 7-303 6934 | 6278 | — ie ans 

| | 
1-0 4-231 ae seks cote) “eae Ga - a 
7-289 - ms rt im ok | we ae -“ 





























Table 4. The 5 and 1% points of ¥2 for equal weights 





5% | 1% 








5. APPLICATION OF THE TESTS 


In this section three sets of data are given to which the ¥3 or F, tests can be applied. The first 
two relate to 2 x k contingency tables and are taken from the paper by Armitage (1955); the 
third is an artificial analysis of variance table. The justification for applying the test to 2 x k 
contingency tables is as follows. Suppose that out of n; observations in the ith category 
a proportion p; show a certain characteristic; it is desired to test whether these proportions 
are equal. If each n, is large and p; not too close to 0 or 1 we can assume that p; is normally 
distributed with variance P(1—P)/n;, where P is the proportion showing the characteristic 
in the whole sample. The problem is thus in a form suitable for the application of the ¥3-test 
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with a; = n,/{P(1—P)} (¢ = 1, 2, ...,k). This approximation is, of course, the basis of the y*- 
test and is usually considered to be adequate if no expected cell frequency is less than, say, 5. 


Example 1 


The data shown in Table 5 are given in Armitage’s paper, where references to the original 
work may be found. The null hypothesis is that the chance of being a carrier does not depend 


Table 5. Relationship between nasal carrier rate for streptococcus pyogenes 
and size of tonsils among 1398 children aged 0-15 years 











a Enlarged tonsils 
not enlarged Total 
+ 
++ +++ 

Carriers 19 29 24 72 
Non-carriers 497 560 269 1326 
Total 516 589 293 1398 
Carrier rate 0-0368 0-0492 0-0819 — 























Table 6. Changes in the size of ulcer crater, 3 months after treatment, 
for patients in two treatment groups (A and B) 














Number of cases with crater 
Treatment Total 
group 
Larger <% healed > % healed Healed 

A 6 4 10 12 32 

B 11 8 8 5 32 

nN, 17 12 18 17 64 

Proportion in 0-353 0-333 0-556 0-706 — 
group A 


























on size of tonsils; the alternative that the chance increases with size of tonsils. We note that 
the proportions are in the order expected under the alternative and hence ¥3 has the same 
value as x? for this table. 

Thus 3 = 7°863, 516 x 293 


~ Paz = J Fe + 589) (589 + 293) 


Referring to Table 2 this is found to be significant at the 1% point in contrast to the 
customary y*, for which the significance lies between 2} and 1%. 


= 0-394, 





Example 2 

Table 6, also from Armitage’s paper, gives the results of an experiment to compare two 
methods of ulcer treatment. 

We test the null hypothesis that the two treatments are equally good, against the alterna- 
tive that treatment A is better than treatment B. Under this alternative we should expect 
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the proportions to increase as we move from left to right across the table. In this example the 
proportions are not in the expected order to begin with. Because the first is greater than the 
second, the first two groups are combined into one giving a table with three groups. This new 
table has the proportions in the expected order. %3 is obtained by calculating y? for this 


pooled table, giving Xi = 5-900, —py. = 0593, —pos = 0-441. 


Extracting the relevant part of Table 3, remembering that p,, and p., can be interchanged, 
we have for the 5 % points, 











Piz 0-5 0-6 
— Pes 
0-4 4-670 4-524 
0-5 4-528 4-354 














Xi is therefore clearly significant at the 5% level (but not at 1%). If the y?-test had been 
used the significance would have been between 11 and 12%. 


Example 3 


The following table gives artificial data constructed to demonstrate the application of the 
F,-test to an analysis of variance table. 


Table 7. Artificial data to illustrate the application of the F,, test 





























Group aay I II III IV V Total 
Total 110 123 126 140 96 595 
No. observed 4 4 4 4 4 20 
Sum of squares 3,380 3,601 3,712 3,984 3,201 12,378 
Mean 27-50 30°75 31-50 35-00 24-00 — 

es 
29-50 
_ oe ~\— ai 
30-17 
—— \- r= 
30-31 

















It is supposed that the alternative predicts that the means will increase as we move from 
left to right across the table. We begin by averaging the means of groups IV and V followed 
by ITI, IV and V and finally II, ITI, IV and V as indicated underneath the table. The reduced 
form of the problem therefore consists of two groups; group I with mean 27-50 and groups 
II-V with mean 30-31. Calculating the F ratio for the reduced problem we obtain 


F = 3-008, 
which is the value of F;, for Table 7. To test the significance we require, from (8) 


_ 3-008 
*=3-008+ 18 


= 0-1432. 
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The following table sets out the method of calculating Pr {F, > 3-008}. As the numbers in 
each group are equal the probabilities P(l, k) are obtained directly from Table 1. 

There is thus no reason to reject the null hypothesis that the groups are drawn from 
populations with the same mean. 


Table 8. Calculations required for testing the significance of F,, 














T,_4(l—1), 3(N —))) 
l Pl, k) 
z= 0-14 z= 0-15 
2 50/120 0-1041 0-0916 
3 35/120 0-2775 0-2512 
4 10/120 0°4779 0-4439 
5 1/120 0-6614 0-6281 

















Pr (z > 0-14) = 0-1696, Pr (z > 0-15) = 0-1537. 


6. FURTHER WORK 
As pointed out at the end of § 4 the greatest need is for tables and approximate methods to 
simplify the method for testing the significance of F,. It would also be an advantage to 
obtain values of P(/, k) for k > 5. If the conjecture given in § 3 above can be proved, then the 
distribution will be completely determined for the case of equal weights. Until this problem 
has been solved the best course appears to be the reduction of the number of groups by 
pooling. This will undoubtedly result in a loss of efficiency but even so may be better than 
the usual x?-test, which takes no account of the order. The answer to this question would 
require the calculation of the power function of ¥7. A new problem arises in the analysis of 
data like that of example 2 in § 4. When applying the ¥7-test it was assumed that treatment A 
would be the better of the two treatments. If we had wished to test for a difference without 
specifying which would be the better the alternative would have had to be, 
Hy: m, > Mz >... > Mz, 
<M, 


or Mm < <... FT My. 


It is hoped to communicate the results of work on these topics later. 


I am indebted to the referee for suggesting a shorter method of deriving the test criterion 
and for pointing out a gap in the original derivation of equation (5). 

Editorial Note added in proof. The recurrence relation for the probabilities P(1, k) conjectured in §3.1 
has now been proved by Mr R. E. Miles. He has also established the more useful recurrence relation 
P(l,k) = [P(l—1,k—1)+(k—1) P(,k—W/k 
for 2 <1 < k—1, which, together with P(1,k) = k4 and P(k,k) = (k!)~1, determine the probabilities 
easily. It is hoped to publish the proof in the next issue of Biometrika. This result can now be used 

for testing the significance of xz and F,, for k > 5 if the weights are equal. 
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SOME PROBLEMS INVOLVING LINEAR HYPOTHESES 
IN MULTIVARIATE ANALYSIS 


By C. RADHAKRISHNA RAO 
Indian Statistical Institute, Calcutta 


1, INTRODUCTION 
We consider p correlated normal variables 4, ..., y,, with the following specification. 

(i) E(Y;) = jy, +--+ 4imTm (1-1) 
or in matrix notation H(y) = At, where y is the column vector of the random variables 
Yy +++) Yp3 t that of m unknown parameters 7, ...,7,, and A, the matrix of coefficients is 
known. 

(ii) The dispersion matrix of y,, ...,y,,ise~UA where eis a known constant and Ais unknown, 
but an estimate S of A is available and has Wishart’s distribution based on f degrees of 
freedom independently of y,, ...,y,. The matrix A is assumed to be non-singular. 

The set-up is thus seen to be that of the theory of least squares with correlated variables 
generalized to the case where the variances and covariances are unknown, but an estimate is 
available. The estimates of parameters as well as the test criteria suggested in this paper are 
essentially those derived by the theory of least squares, substituting the estimate S for the 
unknown A. Fortunately, the distribution problems present no difficulty and valid in- 
ferences can be drawn with the help of the existing ¢ and F tables only. 

A simple case wheresuch a set-up holds is when we have a sample of size n from a p-variate 
normal distribution with an unknown dispersion matrix A and the mean of z,, the ith 
variable, is as specified in (1-1). Here 

eT (1-2) 
and S is the matrix of estimated variances and covariances on f = (n — 1) degrees of freedom. 

In the general set-up, on the basis of a given realization of y,, ...,y, and S we wish to 
examine the following problems. 

(i) Is the specification (1-1) adequate? Thus, if y,, ...,y, represent the average weights of 
a group of individuals at p time points, we may ask whether the average growth curve can be 
represented by a polynomial in time of a given degree. In such a case the parameters repre- 
sent the coefficients of the polynomial trend. 

(ii) If (1-1) is true, how can estimates of 7,,...,7,, be obtained and the precision of 
estimates expressed ? 

(iii) Assuming the specification (1-1), how can general linear hypotheses concerning 
7, +--+) Tm be tested ? 

(iv) How can simultaneous confidence limits to a class of linear functions of 7,, ...,7,, be 
obtained ? 

Problem (i) is a generalization of some particular cases considered earlier, such as testing 
the equality of means of p-correlated variables, equality of means of subsets of variables, etc. 
(Hsu, 1938; Rao, 19466, 1952). Problem (iv), which is the main motivation for the present 
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paper, is an attempt to obtain confidence bands of a smaller width (see § 4) than those given 
by Hoel (1954) in the case of linear regression such as polynomial growth curves, dosage- 
response relationships, etc., which are covered by the general set-up (1-1). 


2. TEST FOR ADEQUACY OF THE SPECIFICATION (1-1) 


Let B be a matrix with r, equal to p minus the rank of A, independent vectors 


— eon = 
Gs yaa (21) 
te Migr l.@ 


‘pr 

such that the vectors in B are orthogonal to those in A’. The computation of B, known as the 
deficiency matrix of A’, can be conveniently carried out by the method of sweep out (Rao, 
1952, §1a-3). It is easy to see that the variables z,, ...,z, defined by 


% = by Yt... + Mere 
ee (2-2) 
= by Yt “ve + bpp Yps 
are such that 
E(z,=0, (¢=1.,...,1) (2-3) 
independently of the unknown parameters t, and with dispersion matrix equal to e*BAB’. 
Given y), ...,y, and S we can compute 2,, ..., 2, by (2-2) and their estimated dispersion matrix 
e BSB’ = e-!G(say). It is easy to see that G itself has a Wishart distribution based on the 
same degrees of freedom f as that of S and is distributed independently of 2, ..., z,. 
The problem of testing the adequacy of the specification (1-1) is the same as that of 
testing whether the r correlated variables defined in (2-2) have zero mean values. The 
appropriate statistic for this is Hotelling’s 7’ defined by 


T, =U Ga = 53g 2, (2-4) 
with the corresponding variance ratio (Rao, 1952, p.71) 
f+li-r 


T, (2:5) 


r 


based on r and (f+ 1-—r) degrees of freedom. The matrix B is not unique but the statistic 7, 
is invariant as we shall see below. 

An alternative way of deriving the test criterion is to consider first the statistic appro- 
priate to test the specification (1-1) when A is known. This according to the least squares 
theory is the residual quadratic form 


min e(y — At)’ A-(y — At) (2-6) 
obtained by fitting the parameters by the method of least squares. This residual quadratic 


form (2-6) for known A is distributed as x? on r degrees of freedom. When A is unknown we 


may consider the statistic 
min e(y — At)’ S-(y — At) (2-7) 


obtained by substituting the estimate S for A in (2-6). 


Given the matrix B of (2-1) it is easy to see that there exists a matrix F of rank (p—r) and 
order (p—r,7r) such that BSF’ = 0, and with such a choice of F (Rao, 1952, p. 53) 


(y —At)’ S“(y — At) = (By)’ (BSB’)-(By) + (Fy — FAt)'(FSF’)-(Fy—FArt) (2-8) 


ieee 
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which is the sum of two positive definite quadratic forms with the first expression inde- 
pendent of t. By choosing t such that Fy = FAt, the second expression becomes zero, 
leading to the result 


min (y — At)’ S~“(y — At) = (By)’ (BSB’)“! (By) = z’G—z. (2-9) 

Thus the statistic (2-7) is same as 7, defined in (2-4) apart from a constant multiplier. 
Incidentally the invariance of T, with respect to the choice of B is also established. 

We, thus, have two methods of computing the statistic 7, either to find a B and compute 


the quadratic form z’G—z or obtain the minimum value in (2-6) directly by some other 
method. 


3. TESTS OF LINEAR HYPOTHESES 


In this section we consider the problem of testing linear hypotheses assuming the 
specification (1-1) to be true. Let 
Uy, 7 +... + UimTm = “| 
is Grd (3-1) 
Ujy Ty + +.» + Upmtm = Ens 
or in matrix notation Ut = &, where U and & are known, be a set of linear hypotheses to be 
tested. The rank of U is taken to be k. Let us suppose that there exist linear functions 
Zpy 1s +++r ppm OF Yj, ---»Yp Such that 
E (2,44) = Uy Ty + ---+UimTm- (t= 1,..., 4) (3-2) 
A linear function u,7, + ... + UT mis said to be not estimable if it cannot be expressed as an 
expectation of a linear function of the variables y,,...,y,. A linear hypothesis cannot be 
tested when the parametric function associated with it is not estimable, since such a para- 
metric function can assume any arbitrary value without altering the probability of the 
observations. In the case of a set of linear hypotheses such as (3-1) each of the associated 
linear functions must be estimable (Rao, 1952, p. 83), the condition for which is that there 
exists a matrix L of order (k, p) such that U = LA, where A is the matrix of (1-1). 
The hypothesis (3-1) together with the specification (1-1) is equivalent to the hypothesis 


E(z,+1) = £1 -++y B(Z,4%) ate Ep. (3-3) 


E(z,) = 0,..., H(z,) = 0, (3-4) 
where 2,,...,2, are as defined in (2-2). Independent estimates of the variances and co- 
variances of 2,, ..., Z,,; derivable from S have a Wishart distribution on the same degrees of 
freedom. The problem of tes’.ng a hypothesis such as (3-3) given (3-4) was discussed in 
earlier papers (Rao, 19466, 1949). The appropriate test is as follows. 

Let D bethe transformation matrix defining 2, ...,z,,,,in terms of y;, ..., y,. The estimated 
variance-covariance matrix of z,,...,Z,,; is DSD’ = H (say). If H- = (h%) is the reciprocal 
matrix, then the statistic for testing given values of expectations of all the (r + k) variables is 


given that 


Tn = S'S, bile, — Ble) le)— Ble) (3:5) 
fifa 
The statistic T, for testing the expectations (3-4) is already defined in (2-4). The statistic for 
testing the hypothesis (3-3) given (3-4) is 
f+1-—k-rf,,,-7, 
k 1+7, ’ 





(3-6) 


4-2 
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which is a variance ratio based on k and (f+ 1—k—r) degrees of freedom (Rao, 1952, p. 83). 
We observe that the value of (3-6) would be the same for all choices of linear functions 
Zr44> +++» p44 Such that their expectations are as in (3-2). The optimum properties of a test of 
the type (3-6) is discussed in an earlier paper (Rao, 1949). 

An alternative method of computing 7,,,, without necessarily making a transformation to 
new variables, is provided by the following equation 


L,., = min(y— Arty S(y—An), (3-7) 
where the minimization is subject to conditions (3-1) on t; whereas 
Ly = min (y— Ary Sy — An), (3:8) 


the minimization being unrestricted. 

A third method of computing 7,,;, or directly the difference T,,,;,—T,, is provided by the 
theory of least squares (Rao, 1946a). This makes use of the estimates of t obtained by 
minimizing, unconditionally, (y— At)’ S-!(y — At) for which the normal equations are 


A’S-ly = A’S-1A8, (3-9) 


where ¢ represents the estimates. Let C denote the reciprocal of A’S-!A, if it exists, or 
a pseudo-inverse as defined by Rao (1955), and 


dy = Uy Ty +--+ UimFin (= a | (3-10) 
Then Ln, 4—) = (d—8) (UCU’)>\(4-€) (3-11) 
where U and £ are given in (3-1). Substituting for the numerator in (3-6) the right-hand side 


expression of (3-11) we find that 


(f+1—k—r)e (d—&)’ (UCU'\-1(d—&) 
kf +2, 


has a variance ratio distribution on k and (f+1—k-—r) degrees of freedom. 





(3-12) 


4. SIMULTANEOUS CONFIDENCE LIMITS TO A CLASS OF LINEAR PARAMETRIC FUNCTIONS 


Let us first consider the problem of setting up confidence limits to a single estimable para- 
metric function 





A = UT +... + Un Tm: (4:1) 
Using the notation adopted in §2, we find from (3-12) that if d = u,7,+...+Um%m and 
g =u’Cu 
a-a |(AI— 7) 4-2 
C—O \gfa+D) ie 
has a ¢-distribution on (f—1) degrees of freedom. Hence, the confidence limits to A are 
is -4 
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In particular, confidence limits to any single parameter 7, can be obtained by choosing 
A = 7; provided it is estimable. The confidence limits to 7; are 


A e(f—r) \-# 

ag’ (aga 7 ™) 

where ¢;; is the ith diagonal element in the matrix C. 
Now we let the vector u belong to the k(< m) dimensional subspace spanned by the 


vectors 
Uy ae Uym 
U=[. Bae r (4:5) 


adi 2s. aes 


(4-4) 


and represent, as in (3-10), 


d;—A, os (w437,+ coe + Wim Tm) —A,. (a => 1, sees k). (4-6) 
Then it is known that (Rao, 1946a, 1952, p. 85), 
(u’@—u't)? _ P ebiadidi sa ? 
a a (d —A)’ (UCU’)-1 (d—A) (4:7) 


when uw is restricted to the subspace (4-5). Using the distribution result (3-12) 
(u’%—u't)? (f+1—k—-r)e 

max wu “fk(l+T) 
has an F-distribution with k and (f+1—k—r) degrees of freedom. If F, represents the 
a-value of F' corresponding to these degrees of freedom then the probability that 

(we-u's)? 4, Wf(l+%) 

uCu os“ e( f+ 1—k—r) 

for all u in the subspace spanned by the vectors in (4.5) is not less than 1—«. The simul- 
taneous confidence limits for all u’t where u’ belongs to U is thus provided by 


A+ + tintin | (Fe Gena): (4-10) 
The argument employed here is the same as that used by Tukey (1951), Scheffé (1953), Roy & 
Bose (1953), Hoel (1954) and others. It may be observed that the first attempt to obtain 
such simultaneous confidence intervals was due to Hotelling & Working (1929). The result 
(4-10) differs from that given by Hoel (1954) in that, in effect, he bases the confidence interval 
on the distribution of F on p, the number of variables y, and (f+ 1—) degrees of freedom 
irrespective of the dimensionality of the subspace of vectors u’ for which simultaneous 
confidence intervals are intended. Unless the factor (1 + 7;,) in (4:10) is very large, which may 
happen when the specification (1-1) is not correct, in which case the procedure suggested is 
not valid, the confidence interval based on F, with k and (f+1—k—r) degrees of freedom 
should be smaller in length when k < p. 





(4-8) 








(4-9) 


5. AN ILLUSTRATIVE EXAMPLE 


The results of the preceding sections show that the computations involved in tests of hypo- 
theses and estimation of parameters are the same as in the method of least squares with 
correlated variables, although the distributions are slightly different due to the estimated 
dispersion matrix being used in the analysis instead of the true one. The computations can be 
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carried up to a certain stage mechanically as in the method of least squares with correlated 
variables. We may briefly review the methods to make this section self-contained for the use 
of those interested in the computational techniques. 
Consider the quadratic form 
(y—At)'S“(y— At) (5-1) 
with the estimated matrix S for the unknown dispersion matrix and obtain the normal 
equations 
A’S-ly = A’S-1A@. (5-2) 
Find a solution t and a matrix C of the variances and covariances of the estimates 
according to least squares theory assuming S to be true. The matrix C is the inverse of the 
matrix A’S-'A, and is unique if the rank of A is equal to the number of unknown parameters 
or a pseudo-inverse (which need not be unique) otherwise. The minimum value of the 
expression (5-1) is given by 
y’S-ly—y’S“1AZ. (5-3) 
The minimum value (5-3), t, a solution of the normal equations, and C, which will be referred 
to as a least squares variance-covariance matrix, are used in obtaining confidence intervals 
and testing hypotheses as shown in the following illustrative example. 
The example refers to observations on growth of ten rats under a control treatment 
considered in an earlier paper (Rao, 1958). The averages of 10 values representing increasesin 
growth during 4 successive weeks are 


Yo = 24:5, yy = 27:5, yo = 241, ys = 30°5 
and the estimated dispersion matrix S, within treatments, based on 24D.F. (pooled from 
other treatment groups also) is 


24-2625 1-7708 — 23125 — 3°1083 
25-3750 26-1042 14-3542 

43-6125 19-1250 

35°5417 


In the notation of §1,e = 10andf = 24. Let us examine whether a second degree polynomial 
in time can be fitted to the first differences of the growth curve or in other words whether 

Ely, =a+ft+yt? (t = 0,1, 2,3), (5-4) 
so that r = 4—3 = 1. The unknown parameters are a, # and y and the matrix A of coeffi- 
cients is 


1 0 0 
4.4 
12 4 
1 3 9 


corresponding to the expectations for ¢ = 0, 1, 2, 3. 
The first step is to obtain the normal equations 


A’S-ly = A’S““At 
which involves the evaluation of the inverse of S and a triple product of matrices. A simple 
way of doing this is first to obtain a triangular reduction of the matrix S, with the vector y 


and matrix A appended, by the square root or Gauss—Doolittle method (Dwyer, 1951; 
Rao, 1955). 
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nie: Table 1. Triangular reduction of matrix S, with y and A appended, 
: for obtaining normal equations (square root method) 
(5-1) ow Matrix S y Matrix A 
rmal it © 
(5-2) (0) (1) (2) (3) (4) (5) (6) (7) (8) 
lates 
f the O-1 | 24-2625 1-7708  —2-3125 —3-1083 24-5 1 0 0 
ates 0-2 — 253750 «26-1042 14-3542 | 27-5 1 1 1 
F th 0:3 — 43-6125 19-1250 24-1 1 2 + 
” 0-4 — — —~ 35-5417 | 30-5 1 3 9 
(5-3) 1-1 4-925698  0-359502 —0-469477 0-631037 4-973914 | 0-203017 0 0 
1-2 — 5-024516  5-228957 2-901983 5-117282 | 0-184498 0-199024 0-199024 
erred 1-3 — —_— 4-006257 0-912171 |—0-080604 | 0-032591 0-239451 0-738670 
rvals 1-4 —. — _— 5-088214 3-706994 | 0-110642 0-433160 1-522860 
ment The rows (0-1) to (0-4) contain the matrix S, the vector y and the matrix A. We consider 
sesin the entire matrix which is now in 8 columns and rows (0:1) to (0-4) and reduce it step by step 
by the square root method till the matrix S is reduced to the diagonal form. In this case only 
4 steps are needed. The figures in columns (5) to (8) in the rows (1-1) to (1-4) containing the 
f reduced matrices are used for further computations. We define the product of two columns 
aie ) as the sum of products of corresponding elements taken from rows (1-1) to (1-4). Thus 
(5, 7] = (4973914) (0) + (5-117282) (0-199024) + (—0-080604) (0-239451) 
+ (3°706994) (0:433160) = 2-604883, 
[5,5] = (4973914)? + ... + (3-706994)? = 64-674697. 
The normal equations are 
a[6, 6] + A[6, 7] + y[6, 8] = [6, 5], 
omial o[7, 6] + A[7, 7] +17, 8] = [7, 5], 
ether a[8, 6]+A[8, 7]+y[8, 8] = [8, 5]. 
(5:4) Computing these products and writing the equations in a form suitable for further com- 
coefii- putations we have 
| a B Y Q 
| 0-088560 0-092449 0-229286 2-361459 
j — 0-284575 0-876129 2-604883 
— oa 2-904349 6-604173 
} where Q with elements Q,, Q,, Q,, stands for the products of column (5) containing the vector 
pasa y with the others. The reciprocal of the left-hand side matrix is 
simp 
ector Y | 22-867188 —26-251429 6-113767 
1951; C= 79-444013 —21-892726 
: 6-465838 
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and by multiplying the rows of this matrix with the column Q we obtain estimates of «, 7, y as 
&@ = 25-994127, # = 0-368153, = 0-110708. 


The elements of the matrix C represent the variances and covariances of the estimates only 
when S is the true dispersion mat.ix. They have to be used slightly differently in expressing 
the precision of the estimates in the present case. The minimum value of (y — At)’ S-(y — At) 
is[5,5]—2Q, —£Q 2 -9Q, = 1-6005. If the object is to obtain this minimum value only then it 
is not necessary to obtain explicitly the solutions of the normal equations. The triangular 
reduction of the normal equations, say by the square root method, gives three values in the 
column for Q, the sum of squares of which is equal to the expression 2Q, + PQ,+7Q,. If 
estimates of parameters and their precisions are also required the method suggested above 
may be followed. 

Test for specification. In the present problem, it is specified that the average differential 
growth curve of the population of rats is a second degree polynomial in time. To test whether 
this specification is adequate or not, we use the statistic (2-5, 2-9) 

(f+ I= in (y — At)’ Sy — Ar), 
rf 7 
which is a variance ratio with degrees of freedom r = 1 and (f+1—r) = 24 in the present 
problem. The value of the statistic 


2410 (1.6005) = 16-005 | (5-5) 
exceeds 4-25, the 5% point of F on 1 and 24p.¥., thus indicating inadequacy of the specifi- 
cation at that level of probability. 

It may be observed that if the object is only to test the adequacy of specification (5-4), the 


alternative method of computing the matrix B and the quadratic form (2-4) suggested in §2 
would be simpler in the present case. The matrix A’ is 


- S 3 2 
(° : 3 ) 
014 9 


and by inspection we observe that the matrix with rank r = 1, which is orthogonal to A’ is 
B=(-1 3 -3 D), 
from which we compute 
% = (—1) Yo + 3y,— 3y2+Y3 = 16-2, 
BSB’ = 163-9081. 


Since there is only one linear function z,, the appropriate statistic is Student’s t. We can 
refer 





1— at 
palticle _f¢ Boo 16001 (5:6) 


to an F table with 1 and 24 .r. This value agrees, to the degree of approximation expected, 
with that in (5-5) obtained by a different procedure. Although the second method is more 
direct, it does not provide estimates of the constants, which may be needed in actual 
practice. But if the sole object is a test for adequacy of the specification then the second 
method may be simpler. 

Precision of estimates. In view of the fact that the assumed specification is not found to be 
adequate by the above test the problem of providing estimates of the parameters a, /, y and 
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their precisions does not arise. We need to look for an alternative specification which will be 
supported by the data. But for purposes of illustration the computations laid out above have 
been used in the following, bearing in mind that the estimates and their precisions acquire 
a meaning only when the assigned specification is not rejected by a test. 

The confidence interval for a parametric function u,7,+ ... + U7 is given by the formula 
(4:3). Obtain the least squares estimate 


A A 
d = U7, +... +UmTm 


and least squares variance, g = u’Cu. The confidence interval is 


taitcm) 


where T. = pinin (y — Art)’ S-(y — Ar). 


In the present example, if a confidence interval for the parameter a is desired the formula is 


o (f-r)e \+ 

ul owes a) Be 
where ¢,,, the first diagonal element in the matrix C, is the least squares variance of the 
estimate of «. Substituting the observed values we have the limits 25-9941 + 4-1263, corre- 
sponding to 95% probability. 

Confidence bands to the differential growth curve. Assuming the specification to be true, let 
us consider the problem of obtaining confidence bands to the polynomial a + ft + yt? (for all 
values of the time). Although vectors of the form (1,¢,/#) do not cover all the points of 
a three-dimensional space the probability statement (4-9) applicable to all combinations of 
a, 8, y is still true as an inequality. For an arbitrary value of time ¢ the estimated polynomial 


value is a+ ft+ yt? = 25-9941 + 0-3682¢ + 0-1107#? 








and the least squares variance of the estimate is the product 


1 
(1, ¢,42) C ( ) = 22-8672 — 52-5029¢ + 91-6715t? — 43-7855t? + 6-4658¢4. 
t2 
The other values needed for an application of (4-10) are 
k=3, f=24, e=10, 14+7%=1-6669, FL, =3-07, a= 0-05. 


Substituting ¢ = 0, 1, 2, 3 we obtain the following confidence limits: 








t#=0 = 2 pe ¢=3 
Lower limit 19-6600 19-8877 19-0383 20-6107 
Mean value 25-9941 26-4729 27-1731 28-0947 
Upper limit 32-3282 33-0581 35-3079 35°5787 























From these values the limits to other values of ¢ can be obtained by graduation (such as free 
hand smoothing) if necessary. The confidence bands are valid only when the specification 
adopted is supported by the data, for which a preliminary test is necessary. 
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TESTS OF SIGNIFICANCE IN CANONICAL ANALYSIS 


By D. N. LAWLEY 
Mathematical Institute, University of Edinburgh 


SUMMARY. Results are obtained concerning the approximate distribution of canonical correlation 
coefficients. A slight improvement is suggested for the test of significance of residual canonical roots. 


1. INTRODUCTION 


In this paper our object is to investigate in some detail the approximate distribution of 
canonical correlation coefficients and the tests of significance associated with them. In 
particular we shall discuss tl approximate test of significance proposed by Bartlett (1938, 
1947) for the residual canonical roots when, let us say, the first k roots, corresponding to real 
relationships between two sets of variates, have been removed. Our approach involves some 
rather tedious and laborious algebra, but we have been unable to find any which is more 
elegant. No attempt has been made to justify the various expansions in series; they are 
presumed to be valid in an asymptotic sense. 


2. ASSUMPTIONS AND NOTATION 


Let two sets of variates containing respectively p and q variates be denoted by column 
vectors x, and x, the corresponding row vectors being x; and x3. We shall be interested in the 
canonical relationships between x, and x2, and we shall begin by considering the true correla- 
tion case where all variates follow a multivariate normal distribution with zero means. 
Without loss of generality, since at most only a linear transformation within each set is 
required, we may assume that their variances and covariances are given in matrix form by 


E (x2) aad fos E (x22) se Z| 


E(x 2) =P, E(2,0’) = P’, (1) 


where J,, denotes the unit matrix of order p and where P = [p,;] is a matrix with p rows and 
q columns such that p;; = 0 if ¢ + 7 and such that p,; = p; is the ith canonical correlation 
coefficient in order of magnitude. We shall assume that the first k (< p, < q) of the p; are 
distinct and positive and that the remainder are zero. 

Corresponding to the above true values we shall suppose that the usual sample estimates 
of the variances and covariances, with n degrees of freedom, are given by 


Ay =1[,+Xy, As = [,+ X29, 
Ay, = P +X, Ay, = Aj = P+ Xqy. 


Thus the X-matrices represent deviations of sample estimates from expectation. 

The squares 73, ..., 72, of the estimated canonical correlation coefficients are the latent roots 
of the matrix 

Ag Ag Ag Ary = (I + Xgq)* (P’ + Xq1) (0+ Xu) (P+ Xp). (2) 

If p < q, the last g—p of these roots are identically zero. The usual difficulty arises with 

regard to the correspondence of these roots with their population values. We shall assume, 

however, that they are arranged in order of magnitude and that with high probability r7 then 
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corresponds with pj for i = 1, 2, ...,4. It would be difficult to investigate the point with any 
degree of rigour, but it seems likely that, roughly speaking, we are justified in this assump- 
tion provided that the sample size is reasonably large and that the first k of the p; are neither 
very near one another nor small. 

Let us now expand the matrix product (2) in the form 


(I —Xoo+X3,—...)(P’+ Xa) (I-Xy + XK—...) (P+ Xp) = P’P+Y, 
where P’P is a diagonal matrix with elements p}, ..., 023. The matrix Y may be expressed as 
Y= Y®+ Y®@+Y®@+..., 

where . YO= X,.(I—P’P)— X35, 

Y® = —X3(I—P’P) + XqoXo5+ Xo X15; 

Y® = X3,(I —P’P) — X%X53— XooX31X13— Xg1 X41 Xj,, ete., 
and where X53 = X99 —P’Xy.—Xq, P+ P' XP, 

X31 = Xi3 = X_,—P’X,,. 


In order to interpret the above notation let us introduce a vector 2, of variates given by 


(3) 


Xs = t,—P'2y. 
Thus x, represents the component of x, which is independent of z,. The variances and 
covariances involving 2, are then given by 
E (525) = E(wy4) = 1-P'P, . 
E(x,2;) = 0 (4) 
The matrices X,, and X;, are to be interpreted as representing corresponding deviations of 
sample estimates from expectation. 


3. VARIOUS EXPECTATIONS 


We now require the expectations of elements and various products of elements of the 
matrices Y®, Y®, Y® and of Y. By the use of equations (3) we can express these in terms of 
the expectations of products of elements of the X-matrices. The latter can be evaluated by 
the usual combinatorial rules and by the use of the relations (1) and (4). The algebra is, 
however, extremely heavy, so we shall not reproduce it in full. Let us denote the typical 
elements of Y and of Y” by y,; and y¥) respectively (i,j = 1,2...,q). Then 
Yi = YP tYP+YP+..., 
and we find, first, that 
E(y4) = (1— pi) (p—a,—pi)/n + O(n), 
k 
where a, = > pj. 
j=1 
For i + j we have E(y;,;) = 0. 
Proceeding further, for i + j, we have 

E(y y2) = (1— p72) (1 —p§) (p% + 07) /m, 

E(y) yd) = —(1—p3) (1-17) (q+ 2) pi + pep |r’, 

Ely ys?) = (1—pi) (1-7) {(q—p + 4, + 1) pi + (Gq — 1) 5 + pi + 0} + 2pip}}/n*, 

Ely? ys?) = (1 —p%) (1p) {(p — 2a, + ag) + (A — 2) (Pi +05) + 2(p§ + pj + pip})}/n*, 


k 
a, = Dp 
s=1 
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We hence find that 
E(yis¥;i)! —p7) (1-3) = (P7 + 7) /n + {(p — 2a, + ag) + (3, — 2p + 4) (P§ + P}) 
+ 2(2p} + 2p} + 3p? p3)}/n? + O(n-). 
In a similar manner we obtain the following results: 
var (y;;) = 4p3(1 —pj)?/n + (1 — pi) (q—a,)/n® + (1 — pi) {(2p —g — 2a, +5) 
+ 2(6a, —- 4p — 11) pi + 39p7}/n? + O(n), 
K3(Ysi) = 24p7(1 — pj)? (1 — 3p7)/n* + O(n-), 
Ka(yii) = 9603(1 —p3)* (1 — 2p) (2— 18p3)/n? + O(n). 


Also, for 7 + j, we have 


var (y;;) = (1 —p§) (p73 + pj — 2p3p})/n + O(n-), 

COV (Yi, Yj;) = (1 — p39) (1 —p}) {— 5(p3 + 29) + 4(p4 + 9) + Sp7p7}/n? + O(n), 

COV {Y iz, (Yig Yja)} = (1 — 3)? (1 — 9) (1 + 5p3 + Pp} — 8p} — pj — 9p7p})/n* — (1 — pZ) (1 —p7)?/n? 
+O(n-%). 


4. APPROXIMATE DISTRIBUTION OF THE FIRST k ROOTS 


We now make use of an expression for the first / latent roots of the matrix P’P + Y. A similar 
expansion was derived in a previous paper (Lawley, 1956) in which we were concerned with 
the internal analysis of a single set of variates. The sth root of the matrix (s = 1, 2,..., k) is 
given by 


r= ra + 1 Vsi¥is 7 1 Ysi¥is it ’ Ysi Vig Vis +0(2 
Pst Ye 2p —pi ~ Yes 2 (pa — pi ACE — pi) (P3 —P}) wy", 


where =’ indicates summation over all values from 1 to g with the exception of s. The validity 
of the expansion depends upon the assumption that the y-variates, which are of order 1/,/n, 
are small compared with the quantities p? — p?. 

By means of this expansion and of the results of the preceding section we are able to 
evaluate the first four cumulants of r? and hence those of r,. We find that 








ae = —" _ &... an , Pi = 
2p,H(r,—ps) = (1—ps)\Ppt+q—2—pzt 21 — Ps) (5 Pe) [nom ), 


var (r,) = (1—p9)"/n+O(n-*). 
Ks(r,) = — 6p,(1—p2)?/n? + O(n), 
K4(r,) = —6(1 —p2)! (1 — 12p2)/n? + O(n-4). 


In general, it seems useless to seek a better approximation to the variance of r,, since the 
term of order n~? is extremely cumbersome. The variance depends to a considerable extent 
not only on the value of p, but also on the differences p? — p?. It is, however, worth consider- 
ing the case where k = 1, i.e. where p, is the only non-zero canonical correlation coefficient. 
More generally, for k > 1, we can consider 7;, under the somewhat restrictive assumption 
that the first k — 1 of the p; are near unity while p;,, is moderate. For these cases, writing p in 
place of p, we have 

E(r,) = p+4(1—p*) (mp —p)/n, 
var (r,) © (1 —p?)?/n + (1 — p*)? {11p? — 2(m —k + 1) —mp~*}/n?, 
where m = p+q—2k. 


It is natural to apply the usual z-transformation in order to normalize the distributions 
of the canonical correlation coefficients; but in general this is unfortunately of little help 
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as it fails to stabilize the mean and variance to any marked extent. The transformation 
is only worth while if we are prepared to make the same assumptions as in the preceding 
paragraph, in which case, writing r for r,,, let us put 
oe l+r m l+p 
heen 2 log.7— c= blog. 75° 
Then since 
2-€=2+px?+4(1+3p")23+..., where x = (r—p)/(1—p?), 

it is easy to show that 

E(z) $+ }(p+mp)/n, 

K,(2) = 1/(n—p—q+k—1+}p?+4mp”), 

K3(z) = O(n), k4(z) = 2/n? + O(n). 


It is of particular interest to consider the multiple correlation coefficient between one 
variate and another set of p variates. In this case, putting q = 1, k = 1 and m = p—1, we 
have 

E(z)xO+ t{p + (p—1)p}/n, 
var (z) ~ 1/{n—p—1+4p?+43(p—1)p}. 
The mean and variance of z are not as well stabilized as in the case of an ordinary correlation 
coefficient, and the results clearly break down if p tends to zero. For practical use it would be 
necessary to substitute r for p in these formulae. 

Though the result has little practical importance, it may be shown that the correlation 

coefficient between r; and 1; (i < j < k) is 





2p:p;(1 — pi) (1-93) 

: +O(n-*). 

mpi — p3) ie 

This breaks down if either p7, pj or the difference between them is small. 


5. TEST OF SIGNIFICANCE OF THE RESIDUAL ROOTS 


The residual roots rj;;,...,73 are the q—k smallest roots of the matrix P’P+Y. Let us 
partition this matrix in such a way as to divide the first k rows and columns from the 
remaining gq —k rows and columns. Then we may write it as 


% Vie 
Yo, Yoo] " 


where D is a diagonal matrix with elements pj, ..., p3. 

By following the method employed in our previous (1956a) paper we can construct 
a matrix of q—k rows and columns whose latent roots differ from r},;, ...,73 only by terms 
of the fifth or higher degree in the elements of Y. This matrix is given by 


Z = V9 — Yo) DY 2 — Yoo Yo, D~*Yq2 + Yoy DY; DV 2 — Yon You DY 2 Yoo 
+ Yoo Yo; D-*Y,, DV 49 + Yoo Yo, DY, D-*V 42 — Yo: DY, DY, DY 
+ Y, DY,2 2; D~-*Yyp. (5) 


For our present purpose it is necessary to carry out the expansion as far as terms of the 
fourth degree, whereas the corresponding expansion used formerly was taken only as far as 
terms of the third degree. The validity of the expansion depends on the fact that the elements 
of Y are small in probability compared with pi. 
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The log-likelihood ratio criterion used by Bartlett for testing the hypothesis that p,.,,,...,p4 
are all zero is, apart from a multiplying factor, 


—log, II (1-19). (6) 


i=k+1 
The product is that of the latent roots of the matrix I — Z, i.e. is the determinant of J — Z, to 
the order of approximation stated above. Hence the criterion may be written as 
—log, |I-—Z| = tr(Z) +4 tr(Z*) +4 tr(Z*)+..., (7) 

where tr denotes trace or sum of diagonal elements. This, when multiplied by a suitable 
factor, is distributed approximately as y? with (p—k) (q—) degrees of freedom. The factor 
will be determined by finding the expectation of (7) correct to terms of order n-?. 

For this purpose we require the results given below. For the first of these the matrix Y re- 
quires expansion as far as the component Y. Assuming throughout that p, = 0(k < s < q) 
and neglecting quantities of order n-* we have 


E(Yss) “4 (p — a3)/n “ {(p +1) a,— a? = a,}/n?, 
Bly3,) = {(2p—3a, + ag) + (p—a,)"}/n*. 
For 7 + s we have 


E(YsiYis) = Pi(1—pj)/n+(1— Pi){(p— 2a, + dy) — (2p — 3a, + 4) pj + 4p7}/n?, 
E(YssYsiYis) = Pi(1 — pi) (p — a, + 2 —p})/n?, 
Ey YirYis) = Pi(1 —p3) {(p — a, + 4) (1 —p}) — 10p7 + 9pF}/n?, 
Byhyt) = of pi) (3— 2p})/n?, 
EY: Vii Yis) = 4p3( (1— —pi )3/n?; 
and, for i, j, s all unequal, 


EY: ¥is¥js) = (1 —p%) (1-95) (9% +09) (1 — pi — P35) /n*, 
EY: Yig YieYis) = pi(1- p3) (1— p}) (p37 + p§)/n?, 
EY se Yis Yes ¥is) = PiP§(1 — p§) (1 —p5)/n*. 
By the use of these results we find, to the same order of approximation, that 
E(tr Yo) = (qk) (p—a,)/n + (q—) {(p + 1) a, — aj — a} /n?, 
E(tr Y.; D“Yy2) = (q—k) (k—a)/n + (q—k) {(b— k) (p — 2a, + ag) — (k— ay) (2p — 3a) 
—4(k—2a,+a,)}/n?, 
Ei tr Yop Yo; D~°Yy2) = (q—k) {(q—k) (b— 2k +a,) + (6—k) (p—a, + 1} /n*, 
E(tr Y.; D“Y¥,; D“"Yys) = (q — k) {2(6 — k) (k — 2a, + ag) — 2(k — a)? + (6— 2k +-a;) (p—4, + 2) 
— 6k + 1la, — 5a,}/n?, 
E(tr Yy, D>Y¥,,; DY, DY) = (q—) {(k— ay) (6— 2k +0) + (b—k) (k— 2a, + 4g) 
+2(b—3k+ 3a,—a,)}/n?, 
E(tr Yo, DY 42 ¥ 2, D~-*¥42) = (q—) {(q—*) vf — 2k +a,)+(b—k) (k—a,+ 1)}/n?, 
where b = > (1/p}). 
Ph 
The expectations of the remaining terms in tr Z may be neglected, and hence 
E(tr Z) = (p—k) (q—k) {1/n + (2k —b)/n*}. 
The only part of tr Z? with which we need be concerned is 
tr {V32— 2¥ 90 Yo) DY 32 + (Yo, D-*Yy2)"}, 














64 Tests of significance in canonical analysis 


since the expectations of all other terms are of order less than n~* and may be neglected. We 
find that 
E(tr Y22) = (q—) {(q—) (p — 2a, + 43) + (p— ay) (p— a, + 1)}/n?®, 
E( tr Yy2 Yo; D-'Yy2) = (¢—) {(q— 4) (hk — 2a, + a) + ( — 4) (p— + 1)}/n?, 
Eftr (Yq, D-*Yy2)"} = (q—) {(q—&) (k — 2a, + ag) + (kh —a,) (k—a, + 1)}/n?, 
and hence that 
E(tr Z*) = (p—k) (q—k) (p+q—2k+1)/n?. 
The expectations of tr Z°, tr Z', etc., are all of order less than n-? and may be neglected. 
Hence, finally the expectation of (7) is found to be 


(p—k) (q—k) {A/n+4(p+q+2k—2b + 1)/n?}+ O(n-). 


Thus, supposing that the values of p,, ...,,, were known, the correct multiplying factor for 
the criterion (6) would be 


k 
n—k—3(p+qt 1)+ 3 (1/p})- 
j= 


This would not only make the expectation of the criterion equal to (p —k) (¢—k) + O(n-), 
but would make the other moments equal to those of x? apart from errors of order n-*, by 
a result established elsewhere (Lawley, 1956). 


Ifp,,..., 0, are all fairly near unity, the multiplying factor isapproximately n — 4(p+q+ 1), 
which is the value suggested by Bartlett. Otherwise an improvement should, presumably, 
be obtained by taking the factor as 


k 
n—k—Hp+q+1) +X (1/19), (8) 


though we cannot claim this to be very firmly established. 


6. THE CASE OF FIXED INDEPENDENT VARIATES 


Let us now suppose that x, represents a set of fixed independent variates and 2, the 
dependent variates. Then the canonical analysis is to be regarded as a regression analysis of 
X_ On x. For given x, the variates x, are assumed to be normally distributed with constant 
variances and covariances and with mean values given by the vector B’x,, where B = [f;;]is 
a pxq matrix whose elements represent coefficients of linear regression. Without loss of 
generality we may assume that the variates are chosen in such a way that £;, = Oif¢ + j and 
that £;; = £;, where /,,...,;, are positive and arranged in order of magnitude while the 
remaining /; are zero. We may also assume that, for given x,, the variates x, have unit 
variances and zero covariances. These assumptions require a change of notation. 

In considering sample values it is now convenient to use sums of squares and products 
(with m degrees of freedom). These form matrices which we denote by Cj, Cy, = Co, and Cy». 
It will be convenient to consider the matrix 


(Coq — Cay Ci Cy)? Co Ca Che, (9) 
which has for its latent roots the quantities r?/(1 —7r?), where i = 1, 2,...,q. 


Estimates, with m = n—>p degrees of freedom, of the variances and covariances of the x, 
(for given x,) are provided by the elements of the matrix 


1 
po (Cop — Co, Ci Cy) = I, + V, 
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where the elements of V represent deviations of these estimates from expectation. To 
simplify matters we may choose the x,, again without loss of generality, in such a way that 
C,, = mI. Then we may write 


1 
rigs Ta C7'C,, = B+X, 


where the elements of the p x q matrix X represent deviations of estimated regression coeffi- 

cients from expectation. They constitute a set of pq independent normal variates each having 

zero mean and variance 1/m and they are distributed independently of the elements of V. 
The matrix given by (9) may now be expressed in the form 


(I+ V)7(B’ + X’) (B+ X) = (I-V + V?-...) (B’ +X’) (B+ X) = BB+ Y, 
where B’B is a diagonal matrix with elements /3(i = 1,2,...,q). The first k roots of (9) 


provide estimates of fi, ..., 42, while the remainder enable us to test the hypothesis that 
Buia +++) Bq are all zero. The matrix Y may be expanded as before in the form 


Y= YO, Y@4YO+..., 


but now Y® = B’X+X'B-VB'B, 
Y® = X’X — VB’X — VX'B+ V2B'B, 
Y® — _yy®, 


Y® = V?Y®), etc. 


Let us partition Y in the same manner as the Y of the preceding section. Then the q—k 
smallest roots of B’B + Y are approximately the same as those of the matrix Z, where Z is as 
given by (5), provided that we now define D as the diagonal matrix with elements fj, ..., £3. 
The latent roots of I + Z are approximately equal to the quantities 1/(1—1r7), fori=k+1,...,q. 
Hence the criterion (6) may in this case be expressed as 


log, | + Z| = tr(Z) —} tr (Z?) +4 tr (Z*) —.... (10) 

In order to evaluate the expectation of this expression it is necessary to recalculate the 

expectations of the various products of elements of Y. This is however a comparatively 

simple process. Assuming throughout that £, = 0(k < s < q) and neglecting quantities of 
order m-* we find that 


E(Y,5) “= p/m + p(q a 1)/m?, 
Ey.) = (p® + 2p +¢)/m*, 


k 
where c= dF}. 

j=1 
For i + s we have E(y:Yis) = Bilm+ {p + (p + 2q + 2) Bi}/m?’, 


E(YssYsiYis) = Bi(p +3+ fj) |m?, 
EY: YirYis) = Pi{(p + 4) + (G+ 4) BB /m’, 
E(ysiYis) = Pi(3 + Bi)/m?, 
Ely: YirYis) = 2Bi(2 + Bi)/m*; 
and, for 7, j, s all unequal, 
EY: ¥ig ¥js) = (Bi + 85 +263 B3)|m?, 
EY siYigVjiYis) = Bi( Bi + Bj + Bi B5)/m?, 
EY si YisY sj Ys) = Bi Bi|m*. 
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We then have 
E(tr Yoo) = p(q—k)/m + p(q—k) (q+ 1)/m?, 
E(tr ¥,,D-1¥,2) = k(q—k)/m + (q—k) {pd + k(p + 2q + 2)}/m?, 
E((tr Yoo Yq; D-*Yy2) = (—k) {(p + q—k+ 1) d+ k}/m?, 
E(tr Y.,D~Y¥,; DY49) = (q—k) {(p + 2k + 2) d+ k(q + 2k + 2)}/m?, 
E(tr Y, DY,, D+Y,,; D'Yj2) = (q—k) (& +1) (4 + 2d)/m?, 
E(tr Yo, DY, ¥, D~-*¥j2) = (¢—k) (+ 1) d+ k}/m?, 


where das ¥ (1/63). 
j=1 
Hence E(tr Z) = (p—k) (q—k) {1/m + (q—k +1—d)/m?}. 
We have alsa, E(tr Y3,) = (q—k) {p(pt+q—k+1)+¢}/m?, 


E(tr Yy2¥2,D-"¥y2) = (q—*) {k(p +q—k +1) +0}/m?, 
E{tr (Yq, D-*¥,2)?} = (q—) {k(q + 1) + ¢}/m?; 
and thus E(tr Z?) = (p—k) (q—k) (p+¢q—2k+1)/m?. 
Hence, finally, the expectation of (10) is found to be 
(p—k) (q—k) {1/m + 4(q—p— 2d + 1)/m?} + O(m-) 
= (p—k) (q—k) {ln +4(p+q—2d+1)/n*}+ O(n), 

putting m = n—p. 

The appropriate multiplying factor for the criterion (6) is 


k 
n—3(p+q+1) + (1/63). 


If f,, ..., 8, are all large the last term may be neglected. If, on the other hand, we replace 
each 7 by its estimate r7/(1 — 17), the multiplying factor will again be given by expression(8). 
We are thus led to much the same conclusion as in the true correlation case. 
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THE ESTIMATION OF PARAMETERS IN SYSTEMS 
OF STOCHASTIC DIFFERENTIAL EQUATIONS 


By A. W. PHILLIPS 


London School of Economics 


1. SUMMARY 


In many fields of study there occur systems of lagged dependences which can be described 
approximately by systems of linear stationary stochastic differential equations. In this 
paper we consider the estimation of parameters in such systems, using an approach similar 
to that of Bartlett (1946, 1955) and Quenouille (1957), and discuss conditions for identifica- 
tion of the separate behaviour relationships of a system. Little is known about the small- 
sample properties of estimates in systems of this kind, but sampling experiments are being 
carried out and the results will be published later. 


2. SYSTEMS OF LINEAR STOCHASTIC LAGGED DEPENDENCES 


A system of linear stochastic lagged dependences between n variables x,(t) which are 
functions of continuous time can be described by the system of convolution integrals 


x,(t) = > [reac uj(t—h)dh+&(t) (i,j = 1,2,...,), (1) 
j+i JO 


in which each of the weighting functions w;,;(h) specifies the magnitude of the dependence of 
the value taken by x; at time ¢ on the values taken by x; at times t—h, and the £,(t) are 
stochastic disturbance t+ms. The Laplace transform of the weighting function of a lagged 
dependence is called the transfer function of the dependence. If all the transfer functions 
of the system (1) are rational functions, i.e. if 





“ew, (h) dh = Pil?) 2 
} 0 if ) a4 4(8 ) ) 
where f;;(s) and a,,(s) are polynomials of finite degree in s, (1) can be written as the system 
of differential equations 
Bi(D) 
Bagh 
in which D is the differential operator d/dt. For the ith equation in (1) is then a particular 
integral of the ith equation in (3), and if the system is stable and the initial conditions are at 
t = —oo it is the general solution of the ith equation in (3). 
Let Q(D) be an n x n matrix whose elements Q;,(D) are given by 


B,;(D) Sou 
qusint ag It (4) 
‘a er 





a,(t)+é,(t) (i,j = 1,2, ....2) (3) 





and let x(¢) and &(t) be column vectors with elements 7,(¢) and £,(t). Then (3) may be written 
Q(D) x(t) = &(t). (5) 


5-2 
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In many fields of study a system like (3) may be used to represent the behaviour of 
a number of separate units which form an interdependent system. Thus the equations may 
represent the behaviour of units of physical equipment, as in control engineering, or of 
groups of persons or firms, as in economics, or of animals or organisms, as in ecological or 
biological studies. In describing real behaviour systems of this sort it is often reasonable to 
assume that the behaviour units cannot respond to change instantaneously. This is equiva- 
lent to the assumption that the weighting functions w,,(h) in (1) do not contain delta-function 
impulse terms,* which in turn implies that the numerator polynomial £;,(s) of each 
transfer function is of lower degree than the denominator polynomial «,,(s). In this paper 
we shall consider only systems in which the numerator of each transfer function is of lower 
degree than the denominator. It will be seen later that this restriction plays an im- 
portant part in the identification of the separate behaviour equations of a system. 


3. SPECIFICATION OF THE STOCHASTIC DISTURBANCES £(t) 


We shall consider only systems which are stable and in which the disturbances £(t) are 
stationary stochastic variables whose covariance functions possess rational two-sided 
Laplace transforms. It will be convenient to assume that the disturbances £(t) are generated 
from ancther set of stationary stochastic variables ¢,(t) by the transformation 


n o 
E(t) = Py ‘ ridh)C.(t-h)dh (¢ =1,2,...,n) (6) 
in which the functions r;,(h) have Laplace transforms R,;,,(s) of the form 
Nix(8) 
R; 8) = eS 7 
KA ) Vixl8) ( ) 


where 7;,(s) and ;,,(s) are polynomials in s, the degree of 7;,(s) being lower than that of 
Vix(8). Equations (6) can then be written as the set of differential equations 


E(t) = R(D) &(t), (8) 


where R(D) is a matrix with elements R,,(D) and ¢(t) is a column vector with elements ¢,,(t). 
In order that the variables £(t) be stationary it is necessary that all the roots of the equations 
Yix(s) = 0 have negative real parts. 

We define the following covariance functions; 


O(7) = EfE(t) '(t—7)}, 
(7) = EXS(t) o'(t—7)}, (9) 
A(r) = EXE(t) E"(t—7)} 


* The d-function or unit impulse function, d(h) is defined by the equations 


0 if h+O0 


an) = | o if h=0 


co 
and ) d(h) dh = 1. 

—o 
(See James, Nichols & Phillips (1947), chapter 2, especially § 2-4.) The Laplace transform of 6(h) is 
clearly unity. If £,,(s) were not of lower degree than a;,;(s) the partial fraction expansion of 


£4s(8)/x,,(8) would contain a constant term and so its inverse transform w;,(h) would contain a 
6-function impulse term. 





ir of 
may 
or of 
al or 
le to 
liva- 
tion 
each 
aper 
ower 


at of 


€.(t). 


tions 


(9) 


S(h) is 
on of 
ain a 











A. W. PHILLIPs 
and denote their Laplace transforms by 0(s), ‘’(s) and A(s). Thus 


6(s) = ig e~$"9(7) dr, 
¥ (8) = | ” e-*rah(r) dr, \ (10) 


hid) = wt e*"A(r)dr. 





It will now be shown that 6(s) is given by 
6(s) = R(s)¥(s) R'(—8s). (11) 
The functions r,;,(h) in (6) may be regarded as defined but zero for h < 0, and the lower limit 


of integration extended to —oo. In matrix notation (6) then becomes 


g(t) = | rihygee—aya, (12) 


r(h) being the matrix with elements r;,(). Post-multiplying (12) by &’(t—7) and taking 
expectations we obtain using (9), 
Hr) = | ” r(h) A(r—h) dh. (13) 


Taking the Laplace transform of (13) and remembering that the transform of the con- 
volution of two functions is the product of their transforms* we have 


6(s) = R(s) A(s). (14) 
Also, postmultiplying (12) by ¢’(¢+7) and taking expectations we find, using (9) 
(7) = i) - r(h) (+h) dh. (15) 
On making the substitution h, = —h this becomes 
(1) = | * (hy) Wha) dh (16) 
and it follows that A’(s) = R(—s) ¥"(s). (17) 


Substituting the transpose of (17) in (14) we obtain (11). 
We now postulate that ‘f’(s) be identically the unit matrix, 


YV(s) = I. (18) 
Substitution of (18) in (11) then gives 
6(s) = R(s) R’(—8). (19) 


Since the spectral density and cross-spectral density functions of a set of variables can be 
obtained from the two-sided Laplace transforms of their covariance functions by replacing 


* See Widder (1946), p. 258, theorem 166. The conditions for the theorem are satisfied as a result 
of the stationarity of ¢(¢) and the conditions that the roots of the equations y,,(s) = 0 have negative 
real parts. 
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the complex number s by the pure imaginary iw (the Laplace transform then reducing to 
a Fourier transform), the spectral densities of the variables ¢(t) are constants for all fre- 
quencies w and their cross-spectral densities are identically zero. The matrix y(7) of their 
covariance functions is diagonal, the leading elements being é-function impulses. Since this 
implies that the variances are infinite, the variables ¢(¢) are not physically realizable.* 
However, (6) remains a valid mathematical model for the generation of the physically 
realizable variables £(t), whose spectral density and cross-spectral density functions, given by 
O(iw), are proper rational functions of iw as a result of the restriction that 7;;,(s) in (7) be of 
lower degree than y;;(8). 


4. COVARIANCE FUNCTIONS OF THE SYSTEM VARIABLES 2(#) 

Substituting (8) in (5) we have 

Q(D) x(t) = R(D) &(t). (20) 
Let P(D) be a diagonal matrix whose ith leading element is the lowest common multiple of 
the denominators of the elements in the ith row of Q(D) and in the ith row of R(D), i.e. the 
lowest common multiple of the polynomials «;,(D), j + 7, in (4) and y,,(D), k = 1,2,..., 
in (7), and let F(D) and G(D) be matrices defined by 

F(D) = P(D)Q(D) (21) 
and G(D) = P(D) R(D). (22) 
Then premultiplying (20) by P(D) we obtain 

F(D) x(t) = G(D) &(t). (23) 
The elements of F(D) and G(D) are polynomials in D, the diagonal element in any row of 
F(D) being of higher degree than the non-diagonal elements in the same row and also of 


higher degree than the elements in the same row of G(D). Thus the determinant |F(D)| 
cannot vanish identically, and we may write (23) as 


a(t) = FD) G(D) €(¢). (24) 

Let ¢(7) be the matrix of covariance functions of the system variables x(t), so that 
(7) = E{x(t) a'(t—7)} (25) 
and let ®(s) be the Laplace transform of ¢(7). Then, by a similar argument to that used in 
wipiaecsais (8) = F-%(s) G(s)¥(6) @"(—s) F’-(—8) - (26) 
or, since ‘f’(s) = J, @(s) = F-1(s) G(s) G’( —s) F’— (-s). (27) 

If we define the polynomial p(s) by 
p(s) = |F(s)| 

= He-a) (28) 


* In engineering literature the variables €(t) are called independent white noise sources. See 
Laning & Battin (1956), pp. 136-44 and Miller (1956), pp. 282-4. 
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and write F%(s) for the adjoint of F(s), (27) becomes 


F%s) G(s) G’(—s) F’%(—s) 
p(s) p(—8) ; 

For simplicity we shall consider in this paper only cases in which the roots A,, 7 = 1, 2, ...,m, 

of the equation p(s) = 0 are all distinct, and shall also assume that p(s) does not contain any 


factor which is common to all the elements of F%(s). Expanding the right-hand side of (29) in 
partial fractions we then obtain 





@(s) = 


(29) 





m K, m Ki 
(8) ix 2 o—A,* —a—A,. (39) 
ies Kew (s—A,) F9(s) G(s) G'(—s) F'(—s)| (31) 





p(s) p(—8) s=),; 


For a simple root A, the matrix F(A,) is necessarily simply degenerate. The adjoint 
matrix F4(A,) is of unit rank and can be written 


F(A,) = kK (32) 
where k, is a column vector which satisfies the equation 

F(A,)k, = 0 (33) 
and x, is a row vector which satisfies 

k,F(A,) = 0. (34) 


(See Frazer, Duncan & Collar (1950) 5-6.) Let J, be a row vector defined by 
(s—A,) k, G(s) G'(—s) F’%(—s)| 





l= ‘ 35 
pls) p(—8) a 

Then substituting (32) in (31) and using (35) we have 
K, = k;l,. (36) 


Thus the matrix K, is of unit rank, with columns proportional to the vector k,. It follows 
from (36) and (33) that F(,)K,=0 (r=1,2,...,m), (37) 


a result which could also have been obtained by premultiplying (31) by F(s) and putting 
8=A,. 

The matrix ¢(7) of the system covariance functions is obtained by taking the inverse 
transform of (30). Formally, (30) does not have a unique inverse. However, for a stationary 
system the roots A, are negative or have negative real parts and ¢(7) > 0ast > +00. It can 
readily be verified that the only inverse which is consistent with these conditions is that 
obtained by taking the first sum in (30) to be the one-sided transform of ¢(7) for 7 > 0 and 
the second sum to be the one-sided transform for 7 < 0. The inverse of the first sum in (30) 
then gives ay 

O(r) = ~ K,e"" (7 > 0) (38) 
r= 


while from the inverse of the second sum we see that ¢(—7) = ¢'(7), a fact which is also 
obvious from (25). 
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5. CALCULATION OF ®(s) FROM GIVEN POINTS ON ¢(7) 


Let ¢, be the matrix of discrete functions consisting of points at unit intervals of 7 on the 
continuous functions ¢(7), i.e. let 





¢,= (7) for (7=...,-—2, —1,0,1,2,...), (39) 
and let M(z) be the one-sided generating function defined by 
M(z) = x g,2". (40) 
Then from (38), (39) and (40) we find that 
K. 
M : 41 
@)= Doty (41) 
where fp =e. (42) 
™ 
We define the polynomial A(z) = TJ (l—-#,2), (43) 
r=1 


and seek matrices U(z) and V(z), whose elements are polynomials in z, such that 
M(z) = U-*(z) V(z). (44) 
If (44) is to hold we require that 





|U(2)| = Cae (45) 
and that U(z) z ont = V(z). (46) 
r=1 


Multiplying (46) by 1 —4,z we obtain 





U(e){Kq+(1—Mg2) p25 = (1-2) VO) (47) 
r+q 
and on putting z = 1/y,, q = 1, 2,...,m, this gives 
u(-) K,=9 (q=1,2,...,m). (48) 
fq 


Since X, is of unit rank, (48) provides m scalar equations in the coefficients of the poly- 
nomials occurring in each row of U(z). If U(z) is given the form 


U(z) = 1+ U,2+U,2+...+U,2, (49) 


where U,, U;, ...,U, aren x n matrices whose elements are constants, each row of U(z) will 
contain cn coefficients of powers of z (excluding the constant terms, which are unity or zero). 
It can be shown that if c is given a suitable value and cn — m coefficients in each row of U(z) 
are put equal to zero, equations (48) suffice to determine the remaining m coefficients in each 
row of U(z), provided the positions of the zeros are chosen in such a way that |U(z)| is of 
degree m. It will always be possible to find positions for the zeros such that this condition is 
satisfied, and equation (45) will then also be satisfied. If m is an integral multiple of n it will 
usually, but not always, be possible to take c equal to m/n, in which case cn —m = 0 and none 
of the coefficients is put equal to zero. 
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When U(z) has been determined V (z) can be found from (46). It can be seen from (48) that 
1—y,z is a factor of U(z) K, and it follows from this and (46) that the degree of V(z) is at least 
one less than that of U(z). Thus V(z) is of the form 


V(z) =Wt+Wer...+h424, (50) 


where \,, V,, ..., V_, are matrices whose elements are con.t. .1ts. 
Premultiplying (44) by U(z) and writing the matrices in expanded form, we have 


(I+ U,2+...+U,2) (d9+O,2+...) =W+K2e+...4+h 24. (51) 
Equating the coefficients of 2°, z°+1, ...,in (51) we obtain the difference equation 
$,+U,$,1+.-.+U,9,_¢ =0 (7 2 ¢), (52) 


from which the matrices U,, U;, ..., U, can be calculated if ¢, is given for a sufficient number 
of values of 7. Equating the constant terms in (51) we have 


N = Po (53) 


and equating the coefficients of z, 2, ...,2°-1 we find 


t 
Y= G+ X O.G-~ (t= 1,2,...,c—1), (54) 
from which the matrices }, V,, ..., V__, can be calculated. 

Thus given a sufficient number of points at equal intervals on the system covariance 
functions ¢(7) it is possible to calculate U(z) and V(z). M(z) is then given by (44), and can be 
expanded in partial fractions to give (41), from which the matrices K, and the scalars y, are 
obtained immediately. The roots A, of the equation p(s) = 0 can then be calculated from 


A, = log 4, (55) 
which follows from (42), and the matrix ®(s) can then be found from the K, and A, using (30). 


6. CALCULATION OF Q(s) AND 6(s) FROM ®(s) WHEN ALL EQUATIONS 
ARE OF THE SAME ORDER 


Consider an n variable system defined by (20) or (23), in which all the scalar equations of 
F(D) x(t) = G(D) &(#) are of the same order wu, and which cannot be reduced to an equivalent 
system in which any equation is of lower order. The elements on the leading diagonal of F(s) 
are polynomials of degree u; but as a result of the restriction on the degree of the numerator 
terms of the transfer functions in the matrix Q(s), discussed in § 2 above, the non-diagonal 
elements are of degree u— 1 at most. The coefficient of s“ in each of the diagonal elements of 
F(s) can be taken as unity. There are wu other coefficients of powers of s (including the con- 
stant term) in each of the diagonal elements and w coefficients in each of the non-diagonal 
elements. In calculating F(s) from (s), or equivalently from the K, and A,, r = 1, 2,...,m, 
there are therefore nu coefficients to be determined in each row of F(s). Since |F(s)| is of 
degree nu we have m = nu. We obtain from (37) a set of nw non-homogeneous equations in 
the coefficients of each row of F(s). It can be shown that the equations in each set are linearly 
independent. Thus all the coefficients in F(s) are uniquely determined. 
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Given F(s) we can find Q(s) from 
Q(s) = P-(8) F(s), (56) 


which follows from (21). It will be noticed that the elements of the diagonal matrix P(s) are 
identical with the elements on the leading diagonal of F'(s). The numerator and denominator 
polynomials of the elements of Q(s) as calculated from (56) may have common factors which 
can be cancelled. 

Given F(s) and the K, and A,, G(s) G’(—s) is readily obtained from the equation 


(s) K,F'(—s) | % F(s) K,F'(—s) 


; _eF 
G(s) G’(—s) = = ros T +z Shak (57) 
which is derived from (27) and (30). Using (19) and (22) we then obtain 
6(s) = P-(s) G(s) G’(—s) P’-(-8). (58) 


The numerator and denominator polynomials of the elements of @(s) as calculated from 
(58) may also have common factors which can be cancelled. 


7. CALCULATION OF Q(s) AND 6(s) FROM O(s) WHEN ALL THE EQUATIONS ARE NOT 
OF THE SAME ORDER, BUT THE DISTURBANCES ARE NOT CROSS-CORRELATED 


If all the equations in a system are not of the same order they cannot all be identified unless 
further restrictions are placed on the system. Consider a system F(D) a(t) = G(D) €(é) in 
which the equations are not all of the same order, and in which the arrangement of the equa- 
tions is such that the first equation is of the lowest order and the order of each successive 
equation is at least as high as that of the one preceding it. If (27) is satisfied by the matrices 
F(s) and G(s) of this system it is also satisfied by w~F(s) and wG(s) where yw is an arbitrary 
matrix of constants. We can add to any row of F(s) a multiple of an earlier row corresponding 
to an equation of lower order without violating the condition that the non-diagonal elements 
in each row be of lower degree than the diagonal elements; but we cannot add a multiple of 
any succeeding row without violating this condition. As a result of this condition, therefore, 
/is restricted to a triangular matrix with zeros above the leading diagonal. Given ®(s) for 
this system, the first equation is therefore determinate (and so are any other equations of the 
same order as the first one) but the remaining equations of higher order than the first one are 
not identified without further restrictions on the system. 

If it is known that the disturbances to the system are not cross-correlated, G(s) G’(—s) 
must be diagonal. If ~F(s) and w~G(s) are to be admissible solutions, therefore, must satisfy 
the further restriction that the non-diagonal elements of ~G(s) G’(—s) uw’ be identically zero. 
Writing g;; for the diagonal elements of G(s) G’(—s) the first part of the array formed by the 
elements lying above the leading diagonal of the matrix product wG(s) G’(— 3s) w’ is found to 
” Pugukla Au9iu/s1 PugGirla 

Par Iiulsi t+ He2GJe2s2 Mer 911/41 + H22922/a2 
Msi 911/41 + Us2922/a2 + 33933 /43- 


Since u,;; cannot be made zero, we see from the first element in the array that if g,, + 0, M2 
must vanish. From the second row of the array we see that if g,, + 0 and go. + 0, 5, and 
#32 must vanish. Similarly, from the third row, /4,, 44, and 4, must vanish if 9,1, Jo. and gsg 
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are non-zero. Continuing in this way it can be shown that all the elements yu,;, (i > j) must 
vanish if all the elements g;;, (¢ = 1, 2, ...,.—1) are non-zero. The matrix yw is then diagonal, 
and all the equations in the system are identified. 

To calculate F(s) for the system we have just been considering, given ®(s) we first note 
that since the equations of lowest order are identified without restriction of the disturbance 
covariance functions, it will be possible to find coefficients in at least one of the rows of F(s) 
which satisfy the appropriate set of scalar equations derived from (37) for all the value of r. 
The number of equations will be greater than the number of non-zero coefficients in this row, 
but they will form a consistent set with a sufficient number of independent equations to 
determine the non-zero coefficients. In the present case the first equation in the system is of 
lowest order, so the coefficients in the first row of F(s) can be found in this way. 


aaa i aialaaaie F(s) ®(s) F'(—s) = G(s) @"(—8). (59) 
On the assumption that G(s) G’(—s) is'diagonal the first column of the matrix product in 
(59) yields the equations 

x = F,;(8) Djg(s)Fig(—8) =9 (¢ = 2,3,..., 0). (60) 
= q= 


If we give ®,,(s) and F,,(—s) in (60) their known numerical values, multiply through by 
p(s) p( —s) and equate the coefficients of each power of s we obtain for each value of i a con- 
sistent set of linear equations in the coefficients of the polynomials in the ith row of F(s), 
which can be solved for these coefficients. Q(s) can then be calculated from F(s), and 6(s) is 


given by A(s) = Q(s) (8) Q’(—8). (G1) 


8. STOCHASTIC DIFFERENCE EQUATION FOR DISCRETE POINTS ON 2(¢) 


Let I'(z) be the two-sided generating function of the discrete functions ¢, defined in (39), so 
that 


Te)= 5 4,2 (62) 
Since _, = $1, we have from (40) weit 
D(z) = M(z)+M"(z)- $y. (63) 
Substituting (44) in (63) we obtain 
T(z) = U-\(z) V(z) + V'(z-) U' (2) — gy (64) 
or U(z) T(z) U'(z-4) = W(z) W’ (2-4), (65) 
where W(z) is any matrix which satisfies the equation 
W(z) W'(z-) = V(z) U' (2-4) + U(z) V'(z-*) — U(z) 6g U' (2). (66) 


It follows from (65) that I'(z) is also the generating function of the covariance functions of 
discrete variables x, which are generated by the system of difference equations 


U(E-) a, = W(E)e, (67) 
from stationary stochastic variables ¢, with covariance functions 
F I if r=0, 
Exe,€,_,} = ( if 7 +0. (68) 


(The symbol H- in (67) is the shift operator, defined by H~"y, = y,_,.) 
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The discrete variables 2, in (67) may be identified with points at unit time intervals on the 
continuous variables x(t) in (20), and it follows that the sampling properties of estimates of 
the continuous system (20) may be studied by considering the sampling properties of 
estimates of the discrete system (67). The work done by Bartlett (1946, 1955), M. G. 
Kendall (1945, 1946, 1949), Quenouille (1947, 1957), Whittle (1952, 1953), Wold (1949) 
and others on sampling properties and goodness-of-fit tests for autoregressive, moving 
average and mixed processes is therefore relevant to the estimation of parameters in 
systems of stochastic differential equations. Most of the theoretical results which have been 
obtained, however, are valid only for large samples. 

Some sampling experiments are being carried out on systems of the type considered in 
this paper. The results will be published later. 
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DESIGN OF EXPERIMENTS IN NON-LINEAR SITUATIONS 


By G. E. P. BOX ann H. L. LUCAS 


Statistical Techniques Research Group, Princeton University 
and Institute of Statistics, North Carolina State College 


1. OUTLINE OF THE PROBLEM 


We suppose that some response 7 is a known function 


9 = f (Ex, So, «+++ Ee: 9,05, ...,0,) =f(E; 8) (1) 
of k variables whose levels are denoted by the elements £,, ..., &;, ..., &), of the vector & and of 
pparameters 0,, ...,,, ..., 9, elements of the vector 6, and that this function is not necessarily 
linear in either the variables or the parameters. We further suppose that it is possible to 
perform a series of experiments or trials in each one of which the response is observed at 
a particular chosen set of levels of the variables decided in advance. 

The problem here considered is that of selecting a programme of trials such that they may 
be expected to provide results from which the p parameters can be estimated with high 
accuracy. In general the experimental programme may be defined by an N xk matrix 
D = {é;,} called the design matrix. The uth row &, of this matrix with elements 
Evy «+s Siws «++» Sey provides the levels of the k variables at which the response is to be observed 
in the uth trial. 

1-1. Example 


The following example illustrates the situation we have in mind. Suppose a consecutive 
chemical reaction is under study in which a substance A decomposes to form substance B 
which then in turn decomposes to form substance C. With the assumptions that the reactions 
are first order and irreversible it may be shown that, after time £, has elapsed, the yield 9 of 
intermediate product B is given by 


n= 7 {exp (—On8:)—exp (—4,8))} (2) 
1 2 





where 0, and 6, are constants measuring the specific rates of the first and second decomposi- 
tions, respectively. 

The problem is to choose a set of times £,,,,u = 1, 2,...,.N, at which to observe the yield so 
that from these observations 0, and 0, can be estimated as accurately as possible, allowing 
for experimental error in the observations. In this example the design matrix D would 
simply consist of a single column whose N elements were the times &,, ..., £4, ---» Ew at 
which the yield was to be observed and @ would contain the two elements 0, and @,. More 
generally there will be k variables (for example, £, = time, £, = temperature, £, = concen- 
tration, etc.) and the design matrix will contain k columns. 


1-2. Practical limiis to levels of variables 


In practice, levels at which variables such as time, temperature, concentration and dosage 
can be set are usually restricted. For example, in the study of the chemical reaction above, 
the feasible range for the variable time (£,) will be from zero to some value £,(max) which will 
be the longest time which could be contemplated in an actual experiment. In general, there 
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wiil exist some experimental region FR in the & space which delimits the area within which 
trials can actually be conducted. In a chemical reaction, for example, such limitation may 
occur from explosive hazards associated with certain combinations of temperature and 
pressure. In other cases it may be simply that it is experimentally inconvenient to conduct 
trials at certain combinations of conditions. In some cases the experimental region can be 
defined by a series of inequalities in the &’s of the type 

£(min) < &; < (max) (i =1,2,...,k). 


In general, however, the definition of R may be more complicated. 


1-3. Criterion for selection of design 


We denote the response observed at the uth set of experimental conditions by y,, and we 


eee er E(y,) = tu = f(Ex 9); (3) 
2 = 
and B(Yu—) Yo) = {G rey (u,v = Lh Bs vseg dl), (4) 


where, in general, o? is unknown. The true values of the parameters are denoted by 
919; 929; --+» Ino, the elements of the vector 6). The partial derivatives of the response function 
with respect to the rth parameter 0, for the wth set of experimental conditions, taken at the 


point 6), is denoted by afte, ®) 
I te daw a 
Finally, the N x p matrix of these derivatives is 
F= ff, rug: (8) 
It is well known that the least squares estimates 6 obtained by minimizing the sum of 
squares N 
es Yu —f(Eus 6)}? (7) 
and given by solving the normal equations 
N - a 
{Yu fEw 9)} {2 Eu 8)/0G,o-8 = 9 (r= 1,2, ...,) (8) 
u= 


have a variance covariance matrix which is approximated by (F’ F)-0°. 

We shall proceed by attempting to choose D so that the determinant |(F’F)-"| is made as 
small as possible. If we assume that each f(€,,, 8) is approximately linear in the neighbour- 
hood of 6, we are thus minimizing Wilk’s generalized variance for the estimates. The logic 
of this choice, also made by Wald (1943), can be seen by noting that if the estimates are 
approximately normally distributed, the determinant | (F’ F)~| is proportional to the volume 
contained within any specific ellipsoidal probability contour for 6 about 8, in the space of the 
parameters. The criterion chosen ensures that any such probability contour includes the 
smallest volume. 

To understand the significance of this criterion in general non-linear situations it seems 
desirable to consider the relationship between sample space, the ‘solution locus’ within 
sample space, and parameter space. The point 6 in parameter space can be mapped on to the 
point P(6) in sample space with co-ordinates 7,, = f(E,,, 8) (u = 1,...,.N). We define the part of 
sample space covered by this mapping as the ‘solution locus’. 
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Now, given any point P(8) on the solution locus, we can make an orthogonal transforma- 
tion n = H€ of co-ordinates in sample space such that the solution locus in the immediate 
neighbourhood of P(8) coincides with part of the p-dimensional hyperplane ¢; = constant 
(i = p+1,...,N). We can then interpret |(F’F)-| as the square of the Jacobian of the 
transformation from co-ordinates (¢,,...,¢,) in sample space to (6;,...,0,) in parameter 
space, when P(®) = P(8,). So the criterion that |(F’F)-1| is to be made as small as possible 
means geometrically that the p-dimensional volume of that part of parameter space asso- 
ciated with a region of prescribed small volume round P(8,) on the solution locus shall be 
as small as possible. Since we do not know 9, in advance, we must assume that we can find 
a design that makes this Jacobian about as small as possible for all points P(®@) near 
P(@,). 

Let us now assume that the part of the solution locus near P(@,) can be approximated by 
a p-dimensional linear subspace of sample space. If we also assume that the experimental 
error distributions are normally distributed as well as satisfying (3) and (4), then the 
confidence region for @ based on the likelihood ratio criterion consists of all points associated 
with points on the solution locus within a p-dimensional sphere centred on the least squares 
estimate P(6), and with radius independent of the experimental design. Any design that 
gives an adequate approximation to the smallest possible value of the Jacobian for all points 
round P(@,) therefore approximately minimizes the p-dimensional volume of the confidence 
region in parameter space. 


1-4. Necessity for preliminary estimates 


We see that the efficiency of different possible designs depends upon the matrix F whose 
elements are the values of the derivatives of the response function with respect to the 0’s at 
6 = 0). Now the derivatives 0f/00, can only be independent of the values actually taken by 
the parameter 0, if the response function f is linear in 0,. For non-linear response functions 
the values of the derivatives, and hence the efficiency of any particular design, depend upon 
the actual values of the p-parameters. If we are to suppose that effective design is possible at 
all, we must also assume therefore that something is known about the values of the parameters 
in advance. 

In practical problems it will almost invariably be the case that some such information is 
available, and this will then provide the basis of a first design. As is inevitably the case here 
and elsewhere, the real effectiveness of the design will depend upon the reliability of the 
information on which it is based. In this paper, therefore, we assume that preliminary 
values 6* of the parameters are available and will proceed so that the design would be 
optimal if these quantities were the true values. Some further discussion of the general 
situation for which this theory is appropriate is given by Box (1957). 


1-5. Possible extensions of the problem 


It is clear that in some examples normality of distribution and constancy of variance 
would not be possible at all points on the response function if only because the variation 
might be limited either upwards or downwards. Two obvious extensions, therefore, of this 
work would be to generalize to a maximum likelihood solution in which any distribution is 
considered or to consider weighted least squares. Valuable work in this direction has already 
been carried out by Elfving (1952) and Chernoff (1953). Again, in some cases we might wish 
to make a transformation of the model before the present theory was applied. 
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Apart from questions of appropriate distribution assumptions it should be possible to 
extend this work in at least two other directions. In the first place in different problems the 
reliability of the preliminary values 6* will be different, and we might take account of this 
by using some rough estimate of the prior probability distribution. Again, some observa- 
tions might be cheaper than others. One could then attempt to find the design giving the 
most information for a given cost. Finally, it would be desire ble in many circumstances to 
use a sequential procedure in which estimates from a preliminary experiment would be used 
to plan a second experiment, the results of which would in turn be used to plan a third 
experiment, and so on. These possibilities will not be further discussed here but we hope it 
may be possible to pursue them in later work. 


2. SOLUTION 
Suppose that we are given the functional form 
Iu =F(Bu; 9) (9) 


and a set of preliminary values @*. Then we shall choose the design D such that |F*’F*| is 
a maximum within the experimental region FR in the §-space, where 


F* = {frs (10) 
and . = [| (11) 


To limit to manageable proportions the possibilities we need to consider, we will in this 
paper assume that the number of trials (that is the number of combinations of levels of the 
variables) is equal to the number p of parameters to be estimated. Each of the p trials could 
of course be replicated to attain any desired degree of precision, but it should be noted that 
an r-fold replication of a design that minimizes the generalized variance using p observations, 
does not necessarily minimize the generalized variance for all possible experiments involving 
rp observations. Experiments in which the number of parameters estimated is equal to the 
number of trials are not perhaps intuitively appealing. This is (i) because one is usually not 
completely assured that the model is correct; so that one ordinarily has in fact a twofold 
objective: to check the model and to estimate the parameters in it if it proves to be repre- 
sentationally adequate, and (ii) because designs in which there are more than the minimum 
number of points may provide greater protection against gross errors in guessing 0*. 

In order for a design to be efficient in ‘checking’ the model, we must be specific about 
what sorts of departure from the model we suspect. In so far as this can be done, we should 
be able to write an ‘alternative’ wider model which makes allowance for these possible 
departures in terms of extra parameters to be estimated. In this way, within the framework 
discussed we can achieve both objectives mentioned above. As a simple illustration con- 
sider the chemical reaction discussed earlier. Here A was decomposed to form B which in 
turn decomposed to C. In a particular problem the second decomposition might be unlikely, 
in which case the primary model in mind for the production of B would be 

= 1-—e“f, (12) 
However, in the light of possible decomposition of B to C it would be appropriate to plan 
the experiment so as to be effective in estimating both 0, and 0, in the model of equation (2). 


When nothing is known about the type of departures which may occur we are confronted 
once more with the fact already mentioned that the effectiveness of a design must depend on 
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the reliability of information on which it is based. If this information is non-existent then 
we have no basis on which to plan. In practice, however, the situation may arise where some 
information is available which is difficult to express in terms of extra parameters in the 
model, but is manifested in feelings about the way the response surface may be distorted. In 
this case further points might be added to the design in an intuitive way, so as to tie down 
doubtful areas of the surface, while at the same time bearing in mind the locations already 
determined which ensure maximum reliability for the principal parameters when the model 
is adequate. 

When gross errors may occur in guessing 6* the present theory can be used to explore the 
changes that would occur in the position of the optimal p design points with changes in 0* 
over the region of uncertainty and the losses in efficiency which occurred with given errors 
in 6*. If more than p-points were available these might then be chosen so as to minimize the 
loss of efficiency as far as possible. 


2-2. A geometrical formulation 


For that class of designs for which the number of trials is equal to the number of para- 

meters, F* is a square (p x p) matrix. Consequently, 

|F*’F*| = |F*|? (13) 
and we should choose the design D so that the modulus of |F*| is a maximum in the experi- 
mental region R. 

In understanding the problem to be solved and in showing the properties of solutions in 
simple cases, the following geometrical formulation has been found of help. Consider 
a p-dimensional space in which the co-ordinates are the derivatives 

of(, ® 
where, it will be noted, ¢,(€) is a function of € only. The surface in the space of the derivatives 
generated by all permissible values of € we call the ‘design locus’. Thus with any particular 
choice of p ‘design points’, &,,&>,...,§,,,---.§», in the -space for a particular design 
matrix D, there will be corresponding points on the design locus in the space of the deriva- 


tives ¢,(&). 


Now the volume of a simplex in p-space formed by p-points 


(Zag, Zags --+5Siy)s +05 (Saqy Mgqy -+0r Say)s «+03 (par Vyge «02 Myy) 
and the origin (0,0,...,0) is proportional to the determinant of the px p matrix {z,,}. 
Consequently, we must find p design points &,, ...,§,,,---,§, for which the corresponding 
points in the space of the derivatives, with co-ordinates defined by equation (14), form with 
the origin the simplex of greatest volume. 


2-3. Example 


As a simple illustration, consider the example given in § 1-1 of a consecutive first-order 
chemical reaction. Suppose that we are given preliminary guesses 67’, 63 for the values of the 
parameters. We wish to choose two values £,,, £;. of time so that the best estimates will be 
available for 0,, 0,. We have 


9 = f(E1; 9, 92) = 0, 


6 Biom. 46 





“1 fexp (— 0461) —exp (—4, E,)}- (15) 











82 Design of experiments in non-linear situations 
The region R is defined by 0 < £4 < S12 < (max). (16) 


but for the moment no upper limit £,(max) will be imposed. We have to choose £,,, £;. 80 as 
to maximize the modulus of the determinant 





A Ate |F*| a $1(E11) $o(E11) ; (17) 
PrilEr2) P2(E12) 
If the preliminary guesses are 
6* = 0-7, OF = 0-2, (18) 
then $1(61) = (0-8 + 1-4£,) exp (—0-7£,) — 0-8 exp (—0-2£)), (19) 
$o(E1) = (2°8— 1-4€,) exp (— 0-2,) — 2-8 exp (—0-78)). (20) 


We can of course substitute equations (19) and (20) in (17) and calculate the values €,,, £1. 
which maximize the modulus of A. It is instructive, however, to study this solution in some 
detail using the geometrical construction. The dotted line in Fig. 1 is a graph of the function 
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Fig. 1. The function f(£,; 0-7, 0-2) and its derivatives. The optimal solution for the design 
is indicated by the heavy dots. 
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Fig. 2. The design locus for the function f(£,; 0-7, 0-2) with the optimal solution 
indicated by heavy dots. 
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f(&1; 0-7, 0-2). On the same diagram are shown the values of the derivatives ¢,(£,), ¢2(&,). 
Fig. 2 shows ¢,(£,) plotted against ¢,(£,) for values of £, covering the range of interest. This 
is the curve we call the design locus. 

In terms of Fig. 2 the problem is to find those two points £,,, £,, on this locus, which to- 
gether with the origin form the vertices of the triangle of greatest area. The exact solution 
obtained by numerical methods described later is £,, = 1-23, £,. = 6-86, corresponding to 
the triangle denoted by the shaded area in Fig. 2. This solution is indicated in Fig. 1 by the 
points at £,, = 1-23 and £,, = 6-86. From the graph of the function f(é,; 0-7, 0-2) it will be 
seen that for this particular example the values are chosen so as to lie on either side of the 
maximum at points of moderately high yield. The graphs of the derivatives illustrate how 
the criterion seeks points at which the derivatives are large in absolute value, but also, so far 
as possible, uncorrelated. 











36-0 
@ 16-0b 
g 
ro) | 
2 
vo 
3 ! 
o 
2 Optimal | 
= solution 
4:0- 
| 
ad . $ 
1:0 S s ri 
. —P gf , © s 
a P 
1 1 L 1 
0 1:0 40 16:0 36-0 


£42 (square root scale) 


Fig. 3. Contours of A for the function f(£,; 0-7, 0-2) in the space of £,,, £:, for 0 < £1, < &1e. 


2-4. Some problems in determining the solution 


This example may be used to illustrate some of the problems in determining the solution. 
Fig. 3 shows contours of A in the space £,,, £;, as defined by equation (17) within the region 
0 < &, < &,9. It is seen that this surface contains two local extrema, both corresponding to 
local maxima in the modulus of the determinant. In terms of the actual value of the deter- 
minant, there is a minimum of A = — 0-810 at the values £,, = 1-23, €;. = 6-86 and a maxi- 
mum of A = 0-039 at about £,, = 7°5, £,, = 15-0. The latter value is proportional to the area 
of a small triangle that can be fitted into the concavity on the lower side of the design locus 
in Fig. 2. This solution is of no practical interest, since the absolute value of the determinant 
is only about one-twentieth of the value which corresponds to the other solution. However, 
it is of some importance to note that surfaces with multiple extrema can occur, and may 
complicate the problem of finding best solutions in more complex cases. 

6-2 
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2-5. Numerical solution 


Although in particular examples there is an analytic solution to the problem of maxi- 
mizing the modulus of the determinant |F*|, often numerical methods must be employed. 
Such methods are attractive because they allow us to obtain solutions even when the func- 
tion f(€, 6) is not given explicitly. In chemical examples, for instance, a kinetic mechanism 
can often be postulated in terms of a series of differential equations which may have no 
explicit solution. The equations may be integrated numerically, however, on a computer and 
the quantities ¢,(§) for any trial value — obtained from difference formulae. Iterative 
methods may then be employed to find the maximum value of the modulus of the 
determinant. 

In the particular example studied it is seen from Fig. 3 that in the neighbourhood of the 
optimum solution the surface is well conditioned, containing no oblique ridges, and that 
consequently a numerical method in which the variables were adjusted one at a time would 
be successful in determining the maximum. It is fairly easy to see that the satisfactory state 
of conditioning indicated by the ‘symmetrical’ maxima found in this problem cannot be 
expected to be general. Often the A surface would contain attenuated ridges which in the 
later stages of iteration would give rise to difficulties in numerical solution when the method 
of adjusting ‘one variable at a time’ or ‘steepest ascent’ procedures were used. A method 
which can be employed when the final solution is approached is the second-order procedure 
similar to that employed by Koshal (1933) in solving maximum likelihood equations. This 
consists of fitting a second-degree polynomial to values of the determinant calculated at 
suitably arranged series of points. 

Calculations for improved values of £,, and £,,, starting from the values £,, = 1-10, 
£12 = 6-50 (obtained from Fig. 2) are shown for the present example in Table 1. 


Table 1. Calculation of improved values of maximum 











bu bi | “= A 
| —7e 

110 | 6:50 | 0-803 336 

1:20 | 650 | 0-807 992 

1:30 || 6-50 0-806 709 

1-10 | 7-00 0-804 758 

1100 | 7-50 0-798 920 

1:20 | 7-00 0-809 632 
| | 








Writing x, = 5(£,,— 1-10), 7, = (€,.— 6-50), the second-degree interpolation polynomial is 
—A = 0-803336 + 0-0152512, + 0-010104a, — 00118782} — 0-01425023 + 0-0008722, 2, 

which has a maximum at x, = 0°66, 2, = 0-37, 

that is £1, = 1-23, fy. = 6-87. 


A second iteration provided values in substantial agreement with these, namely, £,, = 1-23 
and £,, = 6-86. It is clear that because of difficulties of possible multiple maxima and the 
complexities of the A surface, considerable caution is necessary in applying numerical 
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methods to problems in which there are a large number of parameters. It is hoped to discuss 
such cases in a later paper. The examples which foliow contain only a few parameters but 
nevertheless are thought to be of some inherent interest. 


3. EXAMPLES OF NON-LINEAR DESIGNS 


— a a 3-1. Simple decay and growth law 


9 = O,exp (9261), 9 < &,(min) < §), < &_ < (max). (21) 


With £ representing time and with 0, > 0, 0, < 0, this is the well-known first-order decay 
law. With 0, > 0,0, > 0, the function can represent growth phenomena. In application both 
lower and upper limits £,(min) and £,(max) may be imposed corresponding to the earliest 
and latest points in time at which observations can be made. The value of the determinant is 


A = 6, exp {92(E11 + £12)} (G12 — 611). (22) 

The modulus of which for 6¥ < 0 attains its maximum value when 
Ex = §,(min), } 
Ey. = £,(min) — 1/6. | 


Substituting these values into equation (21) we see that the best design will be that in which 
a proportion e~! = 36-8% of the amount of substance present at the first observation 
remains at the second observation. 

For 6} > 0 the modulus of A is a maximum when 


Ey, = §,(max) — ais: 
E12 = §,(max). 


The first observation should thus be made at a time when 36-8 % of the growth expected at 
the final observation has occurred. 

If instead of the amount of substance decayed we consider the amount of product formed 
from a simple decay law, we have 


n = 0,{1—exp (9, £))} 


for 0 < &,(min) < £1 < S12 < (max). (25) 


(23) 


(24) 


The value of the determinant is 


A = 0,[{1 —exp (92 £10)} £11 xP (92 £11) — {1 — exp (92 £11)} 12 EXP (Fe £10)], (26) 
the modulus of which has a maximum when 
E12 = §,(max), (27) 
_ _1_ Sisexp (92 £12) 28 
Su = 63 1—exp(OF £2) 


Substituting these values into equation (25) and letting y, be the fraction by which the yield 
at time £,, = £,(max) falls short of the maximum obtainable, we find that the optimum 
value of £,, corresponds to a yield falling short of the maximum by a fraction 


Vi = exp{—[1+y,log y2/(1—.)]}- (29) 







4 











86 Design of experiments in non-linear situations 


In particular if the second observation is taken after a sufficiently long time so that the 
asymptotic value is almost achieved, then y, is close to zero and y, = 1/e, so that the first 
observation should be made when the process is 63-2 °%% complete. As a second example, if 
the second observation is taken at a time when the process is 50 °%% complete, then y, = 0-73 
and the first observation should be made at a time when the process is 27 °/ complete. 


3-2. Mitscherlich equation 
Consider the model 
9 = 0, +0, exp (93 §;) (30) 


for 0 < &,(min) < £4) < S42 < £13 < (max). 


With 0, < 0 and @, < 0 this expression represents the well-known Mitcherlich law of 
diminishing returns. For example, in crop experiments with £, the amount of added 
fertilizer and 7 the amount of growth, 0,+06, represents the growth when no fertilizer is 
added and @, the hypothetical growth obtained from an infinite amount of fertilizer; 0, 
measures the rate at which the response to each additional increment of fertilizer decreases. 
The same model has been employed to relate the weight 7 of chickens to their cumulative 
feed consumption £, (Hendricks et al. 1932). With 6, > 0 this model has been used to 
represent early growth (Brant, 1951). 
The value of the determinant is 


A = 0,[£1; exp (93 £11) {exp (93 £13) — exp (93 £12)} + £12 EXP (9s S19) 
x {exp (9 £11) — exp (93 £13)} + £13 EXP (93 £33) {exp (93 £12) — exp (93 £1:)}]- (31) 


It is readily shown that irrespective of the signs of 0, 0., 6;, the optimum design is obtained 
with 





£1, = §,(min), (32) 

= oe 3 £1, exp (6F £1,) —£), exp (0F £15) (33) 
” 63 exp (9§ £11) —exp (O$ £13)” 

£13 = &,(max). (34) 


In particular in a fertilizer experiment if £,, = £,(min) corresponded to no dressing of fer- 
tilizer and £,, = £,(max) corresponded to a dressing for which the response fell short of the 
maximum by a certain fraction y,, then £,, would be a dressing for which the response fell 
short of the maximum possible by a fraction y, where again y, would be given by (29). When 
£,(max) is sufficiently large to give an almost maximal response then the intermediate 
value of the design should be that expected to yield a response of 63-2 % of the maximum 
possible, 


3-3. Simple first-order decay with rate a function of temperature 


Consider the model 
9 = exp (—94, £, e~%8s) (35) 


for 0 < &,(min) < £1, < 10 
E,(min) < £5; < Soo 


This would apply for example where 7 represented the fractional amount remaining at time 
t = £, of a material decaying according to the first-order law, when the rate was temperature- 
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sensitive. Assuming that the temperature effect follows the Arrhenius rule, 0, is the specific 
rate at some absolute temperature 7), 6, is proportional to the ‘activation energy’ and 
£, = T’-1—T1 is the deviation of the reciprocal of the temperature, T, from the reciprocal 
of the base temperature 7). 
We find for preliminary values 67, 0¥ that 
In 9* 
* 


$(E1, $2) = —£, exp {— (OF £.4 OF &, e-%22)} = CF 
$o(E1, $s) = —OF £.9,(E1, £) = —E.9* ln 7*, (36) 


where 9% = exp (— 6} £,,,e~°35), the expected fraction of decaying substance remaining in 
the wth experiment. Thus 





? 


_ 1 In nf yf In nF 
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pent —Saa9flnay | 
Now —7 log y hasitsmaximum value when y = 1/e. Also, if the range of permissible values for 
the times, £,, is sufficiently wide then the expression (37) is maximized by ensuring that 
£5.—£; Shall achieve the maximum possible range £,(max)—£,(min) and adjusting the 
times of reaction so that the anticipated fractions remaining, 7}, 7¥, are each equal to 1/e. 
The actual values of £,, and £,, required in this case are obtained by substituting 7 = e-! in 
equation (35). The appropriate times £,,, £,., associated with £,(min) and £,(max) are then 
given by 1 
fu = OF exp {6f £,(min)}, 


E12 = FeexP {OF £,(max)}. (38) 


It is instructive to consider a numerical example. Suppose the absolute temperature is 
restricted to the range 380-420° A. It is then convenient to take as an arbitrary base 
temperature the value TJ, = 400° A. Suppose with time measured in minutes a guessed value 
for the rate 6, at this arbitrary base temperature is 6 = 1-0 and a guessed value for 
6¥ = 16,000, then we have 

6* = 1-0, O* = 16,000 


380° A. < 7’ = (£,+0-0025)-1 < 420° A. 


The optimum design will consist of two experiments, the first of which is performed at the 
minimum temperature of 380° A for time £,, = 8-21 min. and the second at the maximum 
temperature of 420° A for 0-15 min. These times are found by substituting in equation (38) 
and are simply those values at which, if the guessed values are correct and there were no 
experimental error, the fraction of product remaining would be 1/e. The design is illustrated 
geometrically in Fig. 4. In this figure the design locus in the plane of ¢,(£), £2), $o(&1, 9) is 
bounded by the values ¢,(£,,£) = 0 and ¢,(£,,&) = —1/0fe, the largest and the smallest 
values, respectively, that this derivative can take. The straight lines in Fig. 4 are for 
constant £, (i.e. for constant temperature) and the curved lines for constant &, (i.e. for 
constant time). Where, as we have assumed above, the permissible range of £ dictates the 
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design points selected, the design locus is restricted to that portion of the plane within the 
triangle bounded by the three straight lines 


$y(E1, £2) = — 1/0fe, 
P2(E1, So) = — OF $,(E1, €2) (min), 
Pol(E1, $2) = —OF 4 (Es, £2) $o(max). 


The triangle so delineated is itself the triangle of largest area which can be formed with two 
points on the design locus and the origin with only temperature restricted. 

The appropriate design for the case considered is indicated by the two heavy dots in the 
diagram. It will be seen from the figure that, if £, were the restricting variable, then a some- 
what different result would be obtained, since now the triangle of maximum area would be 
achieved when the value of ¢,(£,, ,) fell somewhat short of — 1/6fe. 
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Fig. 4. The design locus for 7 = exp{— 1-Ote16000(?~*-0.0025),, The optimal solution for 7'(min) = 380°A., 
T (max) = 420° A. and 0 < £, < oo is indicated by heavy dots. 


4. CALCULATION OF THE ADJUSTMENTS 


Suppose a design of this type has been obtained for assumed values of the parameters 6*, 
and suppose that the NV calculated values at these sets of conditions for 6 = 6* are given by 
the column vector y*. Suppose finally that observed responses from the N experiments 
performed are provided by the column vector y. Then proceeding in the usual way a p x 1 
vector of adjustments § to be applied to the preliminary values 6* are given to a first 


approximation by é = (F*’F*)-1 F*(y —y*) 


or in the special case where the number of observations N is equal to the number of para- 
meters p by 


6 = F*-(y—»*). 
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In the particular example of § 3-3, 


e|—1/6¥ &» 
ee Yz—e% 
“ang ies a nd | , 
so that the adjusted values will be 
O, = OF +4, 
a, ui OF + de, 


where 6, and 6, are the ‘regression coefficients’ of the elements in y — y* on the columns of 
the matrix F*. 

To see the meaning of this suppose that the value of 6¥ were taken at a base temperature 
such that £,, = — £9, then the adjustments in 67 and 6¥ are simply 


on = -(y- e) eF," 

82 = (Yi — Yo) €/2E a1. 
As would be expected, therefore, when the observed values of y were equal but different 
from the value e—!, this would imply that adjustment was needed only in the basic rate 


constant 6. Unequal values for y, and y, on the other hand would imply the necessity for 
adjustment in 6f. 


5. Discussion 


When parameters are jointly estimated from observations made at particular sets of 
conditions, it frequently happens that the estimates are highly correlated and consequently 
have very large variances. This may be simply the result of poor design in which case the 
first group of estimates may be used as starting values to design a more informative set of 
trials from which greatly improved estimates can be obtained. Not infrequently, however, 
it turns out that the unsatisfactory nature of the estimates is a property of the model itself, 
and that even the best design still yields highly correlated estimates. This point is well 
illustrated by models such as _ 140, 


a 0.+ O56, ; 


In accordance with the method already outlined, the optimal design will be found by 
choosing three points on the design locus which together with the origin form the tetrahedron 
of greatest volume. But the design locus for such a model often turns out to be a nearly 
straight line, so that for any reasonable range of the variable, £,, the volume of the tetra- 
hedron and hence the value of the determinant is small. This arises from the nature of the 
model itself. Whatever values of the £’s are chosen in such examples, when one has found one 
set of values of the @’s that most closely agrees with a given set of data, one can, by making 
suitable compensating changes in the parameters, obtain other quite different values of the 
6’s that agree almost as well. 

In this connexion it is important to distinguish between the problem we are considering 
here, which is that of finding designs most efficient for estimating the param eters 6, and 
a somewhat different problem which is not discussed here, that of finding designs such that 
the response y = f(€; 8) is determined most precisely in a given region. A particular design 
may be such that the estimates, 6, of the parameters are highly correlated with large 
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variances and yet the response, 7, is estimated reasonably accurately. The reason for this is 
not difficult to see. Instability in the 6’s which is compensating is by its very nature not such 
as will cause instability in the estimate of 7. 


The authors wish to acknowledge their indebtedness to a referee and to E. M. L. Beale for 
valuable suggestions for improving the presentation. 
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THE ESTIMATION OF MISSING AND MIXED-UP OBSERVATIONS 
IN SEVERAL EXPERIMENTAL DESIGNS 


By J. D. BIGGERS 
Department of Physiology, Royal Veterinary College, London 


I. IntTRopUCcTION 


The simple analysis of most experimental designs depends upon their fully balanced 
arrangement. Often observations are lost for a few of the units in the course of an experiment, 
and to overcome the consequent difficulties in the statistical analysis, because of non- 
orthogonality, the technique of inserting ‘missing values’ was introduced (Allan & Wishart, 
1930; Yates, 1933). The values which are inserted minimize the error sum of squares. 

In this paper the problem of calculating these missing values will be investigated from 
a general point of view for the following designs: 

(1) randomized block, 

(2) randomized block design with replication within units, 

(3) cross-over, 

(4) latin square and higher squares, 

(5) split-plot. 
Adjustment of the variances of treatment comparisons is sometimes necessary after esti- 
mating missing values, but although this can be done by an extension of the present pro- 
cedure it will not be discussed in this paper. 


NoTATION 
Scalars—letters in italics. 
Vectors—iower case letters in Clarendon type. 
Matrices—capital letters in Clarendon type. 
Transposition of matrices and vectors is indicated by a prime. 
Summation—two summation symbols will be used. If we consider the sequence 
x; (i = 1,2,...”), we define ordinary summation over all values as 2;2;. Also we define 


Ly Xj = Ty +Xyt+HXy 1, say, 


to mean summation over some subset of the subscript values—typically one relating to the 
missing values. 

Associated observations—an observation in a design is denoted by X;;,,__, where the number 
of subscripts indicates the order of classification involved. Thus an observation in a ran- 
domized block requires two subscripts for its specification, and an observation in a Graeco- 
latin square requires four. 

If we consider two observations they may have certain subscripts in common. This 
property enables us to describe the relation between pairs of observations; observations 
related in a specific way will be called associates. For example, we consider two observations 
X jon aNd X yy. The following classes of associate can be recognized: 


(1) zero-order associates: ftugtvh+u; 
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(2) Ist-order associates: (i) iassociates f=u,g+v,h+w; 
(ii) j associates f+u,g =v, h+w; 
(iii) k associates f+ u,g +v,h =w; 
(3) 2nd-order associates: (i) # associates f= u,g =v,h + w; 
(ii) tk associates f= u,g + v,h = w; 
(iii) jk associates f + u,g =v, h = w. 
Particular associates may or may not exist depending on the experimental design. 
A potential observation in a design will be indicated by a capital letter: X;,._; if this is in 
fact a missing observation it will be indicated in lower case: x;;._. 


General solution 


Let there be p independent missing values denoted by 2;(i = 1, 2, ...,). The error sum of 
squares is a quadratic function of these values, F(x, 22, ...,%,). The vector of partial deriva- 
tives of this function is given by 

2(x’A—q’)/N, (1) 
where x is a column vector of the p missing values, 
A is a px p symmetric matrix whose elements are determined by the experimental 
design and the distribution of the missing values, 
q is a column vector whose elements are calculated from the available observations, 


N is a constant determined by the experimental design. 

The values of the x; where F(x) is a minimum are given by the solution of p simultaneous 

equations obtained by equating each of its partial derivatives to zero. These are, in matrix 
notation: 

Ax = q. (2) 

Several methods may be used to solve equation (2). Most textbooks on the design and 
analysis of experiments give the formula for one missing observation in randomized block, 
cross-over and latin-square designs, and the special formulae for two or three missing 
observations have also been published for the randomized block design (Baten, 1939, 1952; 
Federer, 1951, 1955) and the latin-square design (Federer, 1955). The split-plot design has 
been dealt with for single missing observations by Anderson (1946) and Khargonkar (1948). 
Usually, where more than one missing observation exists in a design, it is recommended that 
the estimates be obtained by an iterative process based on the formula for one missing 
observation. Other methods are the covariance method (Bartlett, 1937; Coons, 1957) and 
the method of diagonal iteration (Healy & Westmacott, 1956) for use with automatic 
computors. None of these methods entails the explicit determination of the simultaneous 
equations. In this paper rules will be given which enable (2) to be written down rapidly for 
the different experimental designs. The main advantage of this procedure is that it enables 
the nature of the equations to be examined and this leads to simplifications in several 
important complex cases. 

The matrix method has been the subject of a paper by Thompson (1956) on missing values 
in the randomized block design. This worker, however, has only dealt with a restricted 
distribution of missing values, presumably because values of A~! are written down instead 
of A. Very recently Wilkinson (1957) has shown how the matrix A can be used to obtain 
exact variances of treatment comparisons, and has also extended the method for the 
estimation of missing observations in the analysis of covariance. 
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II. RANDOMIZED BLOCK DESIGN 
Suppose we have r blocks each containing ¢ plots to which ¢ treatments are allotted at 
random. We denote the observation made on the jth treatment in the ith block by 
X,;(¢ = 1, 2,...,7; j = 1,2,...,¢). At the end of the experiment let p of these values be 
missing. It should be noted that the missing observations are indicated by only some values 
of the subscripts. ; 
Let the th block and the jth treatment contain c; and d; missing observations respectively. 


Missing observations in the same block are i or block associates and missing observations 
receiving the same treatment are called j or treatment associates. The missing observation 2,), 
willhave therefore (c, — 1) block associates, (d, — 1) treatment associates and {p — (c, +d), — 1)} 
zero associates. 


Let B; = total of the available observations in the ith block, 
T'; = total of the available observations receiving the jth treatment, 
G = total of all available observations. 


The error term in the analysis of variance is given by 

Diy Ly Lj — Dew (Bz + Dy Xj)? /t — Dey (Tj + Dw Xj)?/r + (E+ Lp Vy %js)?/rt + constant. (3) 
Partial differentiation of (3) with respect to a particular missing observation, x,,, and 
equating the derivative to zero, gives the equation 


Separation of terms corresponding to zero, i and j associates gives 


zero 





i associates j associates associates 
(r7—1) (¢—1) 4g, + (1-1) Xp %qjy + (1—-t) Lo%in+ Lo Ly Xs = 1B, +tT,—G. (4) 
j+#h i+9 i+9 J+ 


Expression (4) enables us to write down the coefficients of the x,;, the B, and 7;,, and hence 
the matrix A and the vector q in (2). The rules which determine the elements of A are: 
(i) (r—1)(¢—1) for the missing observation under consideration, 

(ii) (1—r) for the 7 or block associates, 

(iii) (1—#) for the j or treatment associates, 

(iv) 1 for the zero associates. 

In all practical situations the matrix A will be non-singular, and thus the equation (2) will 
have a unique solution. 

Example 1. Table 1 shows the results of a randomized block experiment (r = 8; tf = 5). No 
missing values occurred in this experiment, but four have been omitted to provide the 
example. The missing values are calculated as follows: 

(1) Write out the table of results so that the rows correspond to separate blocks. This is 
essential to avoid confusion in determining the associates. 

(2) Obtain the coefficients of the associates. In the example these are 28 for the missing 
observation under consideration, —7 for the i associates, — 4 for the j associates and 1 for 
the zero associates. 

(3) Insert in the table of results the letter x,; for the missing value with subscripts 
determined by the position of the missing value in the table, e.g. x,; is the missing value in 
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the third block receiving the fifth treatment. Space should be left to insert the estimated té 
missing value. d 
tl 
Table 1. The wet weight in mg (x) of embryonic chick tibiae after cultivation on a chemically ~ 
defined medium containing five different concentrations of glucose. Treatment numbers are 
placed in parentheses. The variate analysed is log 10x ‘“ 
d 
Glucose concentration (mg./ml.) Com- 
pleted 
Block * block 
0-5 (1) 1-0 (2) 2-0 (3) 4-0 (4) 8-0 (5) totals ) 
I 0-88 1-15 1-33 1:39 1-57 —_ 6-32 ) 
II 1-06 1-22 1-63 1-54 1:37 — 6-82 
Ill 0-97 134 | (a3 = 1-50) 1-66 (23, = 1°53)| 3-97(B,)| 7-00 
IV 1-09 1-21 1-16 1-50 1-48 — 6-44 q 
V 1-14 1:37 1-58 1-52 1-44 — 7-05 t] 
VI 1-13 1-33 1-65 1-57 1-47 — 7-15 
VII 1-00 1-21 | (a5 = 1°44) 1-45 1-52 5:18(B,)| 6-62 
VIII 1-12 1-30 1-35 (ag, = 1°56) 1-61 5-38 (B,)| 6-94 
T 
e: 
T, _ _ 8-70 (7's)| 10-63(7,)| 10-46 (7,)| 4831(@)| — | 
c 
Completed t 
treatment 8-39 10-13 11-64 12-19 11-99 — 54-34 : 
totals tl 
Table 2. Calculation of A and q 
A q 
Subscripts 
33 35 73 84 B, T, G ‘ 
oy ni 
33 28 -7 —4 1 3-97 8-70 48-31 | 
35 p ogee 28 1 1 3-97 10-46 48-31 | 
73 --4 1 28 1 5-18 8-70 48-31 
84 1 1 1 28 5-38 10-63 48-31 } 
r=8 t¢=5 -1 } 
































(4) Obtain the B,, 7; and G from the available observations and write them at the border 
of the table. T 
(5) Prepare a table as in Table 2. List the subscripts in a row at the top and a column at 
the left-hand side of the table. By comparing the subscripts in pairs determine which sub- 
scripts are common. This determines the type of association, and the appropriate coefficient 
is written down at the intersection of the corresponding row and column. At the right of the : 
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table columns for the B,, T; and G are prepared. The ¢ subscript in the left-hand column 
determines the B; total in a given row, while the j subscript determines the 7; total. Beneath 
the B; and 7; columns the values of r and ¢ are written down respectively, and beneath the G 
column the value — 1 is written. 

(6) Invert the matrix A. If the exact variances of treatment comparisons are not 
required A-! need not be obtained explicitly, and it is quicker to solve the equations (2) 
directly with q determined as in step (7) below (see, for example, Fox (1950)). 

(7) Write down the solution as follows: 


A-1 q 
Zag 0-039 0-010 0:005 —0-002 26°95 
Xen | 0-010 0-038 0-000 —0-002 35°75 
ag} | 0-005 0-000 0-037 —0-001] | 36-63 
Xa —0-002 —0-:002 —0-001 0:036. 47-88 


q is obtained by row by row multiplication of each row of the right-hand side of Table 2 with 
the bottom row. Thus, in the example, the upper entry of q is given by 


8 x 3:°97+5 x 8-70— 48-31 = 26-95. 


The values of the z,; are then obtained by standard row by column multiplication. In the 
example 233 = 1-50; 2%, = 1-53; a7, = 1-44; xg, = 1-56. 

(8) The values of the x;; are inserted in Table 1, and the block and treatment totals 
completed. The standard analysis of variance then follows. In this example 4D.¥. are sub- 
tracted from the error term. 

Special cases. The process of calculating A-1 can be simplified if A is a p x p matrix of 
the form: 
= a ere 
ba 
(5) 








| re 
This is a circulant matrix and hence the sum of the elements of a row is a factor of its deter- 


minant. Thus if {a+ b(p—1)} = 0 the matrix is singular. This property will be used later. 
The inverse of (5) is given by 











{a + b(p —2)} —b yok anos —6b q 
a ae i ae ai 
1 be ac de 
(a—b) {a+b(p—1)} 
_ eae 


Thus once A is known, A- can be written down directly. 

The special cases where this is useful in the randomized block design are: 

(1) all missing observations are zero associates, 

(2) all missing observations are either block or treatment associates. These matrices also 
occur in other experimental designs. 
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III. RANDOMIZED BLOCK DESIGN WITH REPLICATION WITHIN UNITS 


Suppose we have r blocks each containing ¢ plots to which ¢ treatments are allotted at 
random, and that in each plot there are s independent observations. The analysis of variance 
takes the form shown in Tabie 3. At the present time there is considerable discussion on the 
linear models which are assumed in the analysis of this design (Anderson & Bancroft, 1952; 
Wilk & Kempthorne, 1955). The models determine the expectations of the mean squares in 
the analysis of Table 3, and these in turn determine the appropriate error terms in the tests 
of significance. There are three error terms to consider: 

(1) the within-plots sum of squares (#;) (Case 1), 

(2) the blocks x treatments sum of squares (£,;) (Case 2), 

(3) (#,;+ E,;) (Case 3). 


Table 3. Analysis of variarce for a r x t randomized block design with 8 observations per plot 











| 
Source of variation D.F. Sum of squares 

Between blocks (r—1) (B-C) 

Between treatments (¢—1) (T’—C) 
Blocks x treatments interaction (£,,) (r—1) (¢-1) (P—B-T+C) | 
Within plots (£,) rt(s—1) (S—P) 
els | 

Total (rst — 1) (S—C) 

















Where S = total sum of squares, C = correction for the mean, B = block sum of squares, T' = treat- 
ment sum of squares, P = plot sum of squares. 


We denote the kth observation on the jth treatment in the ith block by 
Xin (t = 1,2, ...,759 = 1,2,...,65 & = 1, 2, ...,8). 
At the end of the experiment let p;; observations be missing in each plot. Then the total 
number of missing observations is p = D,=,pi- 


The following associates only exist: zero, i, j and ij. 
Let P,; = total of the available observations in the ith plot, 
B, = total of the available observations in the ith block, 
T; = total of the available observations receiving the jth treatment, 
G = total of all available observations. 

The three sets of equations for estimating the missing values when each of the error terms 
are minimized have been obtained by an analysis similar to that applied to the randomized 
block design. The rules which determine the elements of A and q for each case are shown in 
Table 4. 

If we write down (2) for these cases, ordering the elements of A in groups corresponding to 
the 7j, we obtain in general: 


qt 








or 
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where A¥/,(~ = f) are submatrices along the main diagonal, one corresponding to each plot. 
Each is a square symmetric matrix of order p,;. The superscript denotes 
1 at the plot, while the subscript denotes the position of the submatrix, 
nce A,,(% + f) are rectangular submatrices, 
the x") is a vector of the p;; missing values in plot #j, 
a52; q® is a vector of p;; elements calculated from the available observations. 
sin 
- Table 4. Coefficients of associates and typical elements of q for the three cases 
in the randomized block design with replication within units 
| 
Coefficient 
plot Associate | l =v ya 
Case 1 Case 2 | Case 3 
| (Z,) (Ey) | (E,;+ Ey) 
Lai -——| Rea Aa! ERO Re eee? OMe ee ESE! 
Missing value | (s—1) (r—1) (t—1) (rst —r—t+1) 
ij — (r—1) (t—1) (l—r—2) 
a 0 (1—r) =) 
j 0 (1-2) (1—#) 
Zero 0 1 1 
| Typical elements of q 
‘eat- ee ee ae ee ee ee ee 
Case 1 Fy 
Case 2 rB,+tT,—rtP,,—G 
Case 3 rB,+tT,—G 
otal 
If a plot has no missing values the submatrices of the corresponding row and column in (6) 
vanish. The elements of the submatrices along the main diagonal are determined by the 
coefficients for the missing value and its ij associates only. 
We now consider the three cases discussed above. 
Case 1. The matrix of (6) is of the form 
_ RE en en —<- 
. 12 . Oo . 
ized 
vs te ‘ (7) 
O : 
An ad 
ig to rt.r 


Since the inverse of (7) is 
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the estimates of the missing values in plot ij is independent of the missing values in all other 
plots. Therefore the missing values for the ijth plot are given by the solution of 


G-h =) oS et on P, 
-1 -1 . . (s-1)d LeypJ LB, 
Pig X Dig 


This has the solution P,;/(s —p,;) for all the 2,,;,. Thus in this case the missing observations 
are estimated by the average of the available observations in the plot. If all the values in 
a plot are missing p,; = s and the equations have no straightforward solution. 

When r = 1 we have the case of a fully randomized design. Thus an estimate of a missing 
value, if required, is the average of the results available on the particular treatment. 

Case 2. The submatrices, in this case, have equal elements throughout. The A‘/,(a = £) 
have elements equal to (r — 1) (t— 1) whilethe A, ,( + £) have elements equal to (1 —r), (1 —t) 
or 1. The rank of matrix A in all practical cases is rt since it consists of rt sets of identical 
rows of elements. Thus to solve (6) we may allot within each plot (p,;—1) arbitrary values 
and then solve for the remainder. In practice, therefore, we would insert arbitrary values for 
all but one missing value in each plot, say P,;/(s —p,;) for s + p,;, and then write out (6) as 
though one value only is missing in each plot. Alternatively, if we work entirely with plot 
totals we can use the formula for a randomized block design to estimate a missing plot, 
ignoring all the available observations on the plot. This situation arises when we minimize 
the whole-plot error term in a split-plot design. 

Case 3. Here the matrix of (6) is non-singular and cannot be simplified. In this case the 
matrix remains non-singular even if all observations are missing from a plot, thus allowing 
estimates of these values to be made. 


IV. Cross-OVER DESIGN 


Consider an rxt design, where each of the ¢ columns is a separate replicate of the 
r treatments, subject to the condition that each treatment occurs an equal number of times 
(a) in each row. Then ¢ = ar. 
Denote each observation by X;,,(i,k = 1, 2,...,7; 9 = 1,2,...,¢). Let p observations be 
missing. In this design the following associates only exist: zero, i, j, k, ik. 
Let R; = total of the available observations in the ith row, 
C; = total of available observations on the jth column, 
T;, = total of the available observations receiving the kth treatment, 
G = total of all available observations. 


The following rules determine the elements of A: 
(i) (r—1)(¢—2) for the missing observation under consideration, 
(ii) 2(1—r) for the i/ associates, 
(iii) (2—r) for the i and k associates, 
(iv) (2—t) for the j associates, 
(v) 2 for the zero associates. 
A typical element of q is given by 


rR, + tC, + rT, — 2G. 








SF SB 8S ty 


ther 


ions 

















J. D. BiaGEers 99 


When r = 2 the coefficient for i and k associates is zero. This leads to independence of the 
equations for estimating the missing values in some instances, thus allowing the formula for 
a single missing value to be used separately for each plot. A similar situation arises in split- 
plot designs (see Example 2). 


V. LATIN-SQUARE DESIGN 


The formulae for a ¢ x ¢ latin-square design can be obtained from those for the cross-over 
design by putting a = 1. Under this restriction ik associates do not exist. Thus the rules 
which determine the elements of A for the latin-square design are: 

(i) (t—1) (t— 2) for the missing observation under consideration, 

(ii) (2—t#) for the , j and k associates, 

(iii) 2 for the zero associates. 
A typical element of q is then “(Ry +C, + T,) — 24. 


VI. HiGHER ORDER SQUARE DESIGNS 


Suppose we have a txt square of order n, where n denotes the number of classifications. 
Denote the observation made on each plot by X,,4,...an(% = 1,2,...,¢;7 = 1,2,...,m). 
A particular observation will be denoted by X 4, », ... s,, Where the #; represent fixed values of 
the a;. Let p observations be missing. 

In all these designs only zero and Ist order associates exist. 

Let C,, = total of the available observations on the «,th classification, 

G = total of all available observations. 
By an extension of the methods already described it can be shown that a typical equation 
(2) ” (¢ = 1) (¢ +i= n) XB Ba we Bn a (n 1 t) Died DHa,)... 24am) vp, g...an 
Og+hyas+fhs Ontfn 


+(n—1-t) Dendrey)...Len Vay fo... 0n 
+8, %+fs Ontfn 


+ i A eee 
Ss (n— 1- t) Lad 2Aay)...21ea—) Vo, ag... Bn 
1+, pfs On—1+ fn—-1 


7 (n ai 1) Dery) Dilers) oe Leg) Uy. 09...0n 
+A, Os+ Pa On* Bn 


From (8) we may determine the rules shown in Table 5 for writing down the coefficients of 
matrix A for various values of n. n = 2 determines a randomized block design where the 
number of treatments equals the number of blocks. n = 3 determines the coefficients of 
atxt latin square, thus giving an alternative proof of the formula given earlier. 

If in the higher square designs (¢ — 1) Ist order associates only are missing then matrix A is 
of the form (5). The sum of the elements in a row is 


(t—1) (t—n+1)+(t-1)(n-1-8) =0, 


and therefore the matrix A is singular and equation (2) has no straightforward solution. This 
situation arises whenever all the missing values are in one classification, e.g. a complete row, 
column or treatment in a latin square. A full description of methods for dealing with missing 
values in latin-square designs where A is singular is given by De Lury (1946). 


9-2 
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Table 5. Coefficients of associates for square designs of different order 


























| 
No. of constraints 2 3 | 4 5 n 
j 
Bs eda, SL ; 2 
Associate Randomized | Latin square | Graeco-latin | Hyper-graeco- — 
block square | latin square 
s=r=t 
settles ect | CPMELORA . wintd Dok td 
Missing observation | (¢—1) (t—1) | (t—1) (t—2) | (t—1) (¢-3) Ze (t—1) (t—4) (t—1) (t-n+1)| 
Ist order (1-2) (2-?) | (3—t) (4—t) (n—1-t) | 
Zero 1 2 | 3 | 4 (n—1) | 
} | 

















VII. SPLiIt-PLOT DESIGNS 


(1) Whole-plot treatments arranged in randomized blocks 


Consider a design in which r blocks containing ¢ plots to which ¢ whole-plot treatments are 
allotted at random. Further let s split-plot treatments be allotted at random within each 
whole plot. The analysis of variance of this design is given in Table 6. There are two error 


terms to be considered: (1) EZ, corresponding to the whole-plots (Case 1), and (2) E,; corre- 
sponding to the split-plots (Case 2). 


Table 6. Analysis of variance for a split-plot design with whole-plot treatments 
arranged in randomized blocks 























Source of variation | D.F | Sum of squares 
| 
: | 
Between blocks (r—1) | (B-C) 
Between whole-plot treatments (A) | (¢—1) | (S—C) 
Error (Z,) Pha (t—1) | (W-B-S+C) 
= " | a 
| 
Total (rt—1) (W-C) 
anne Cee me et Mere 
Between split-plot treatments (B) | (s—1) | (T'—C) 

AB interaction | (s—1) (¢-1) (I-S-—T+C) 
Error (Z,,) | t(s—1) (r—-1) | (Z—W-I+S) 
suid Seioborets noi Soaae | wed 

| | 
Total | (rst — 1) | (Z—C) 





Where Z = total sum of squares of split-plots, W = total sum of squares of whole plots, C = cor- 
rection for the mean, B= block sum of squares, S = whole-plot treatment sum of squares, 7’ = split- 
plot treatment sum of squares, J = treatment combination sum of squares. 

We denote the observation made on the kth split-plot treatment in the ijth plot by 


Xi (i = 1,2,...,7; j = 1,2,...,t; k = 1,2,...,8). At the end of the experiment let p split- 
plots be missing. 


The following associates exist: zero, i, j, k, ij, ik, jk. 





fu 
is | 


cor- 
plit- 


, by 
olit- 














J. D. BiaGErRs 101 


Case 1. Table 6 shows that the expression for the error term is the same as that in Case 2 of 
the generalized randomized block design. The solution in the two cases is identical. We ignore 
the available observations and estimate new whole-plot values using the formula for 
a randomized block design. 

Case 2. Let W;,; = total of the available observations in the ijth plot, 

I, = total of the available observations receiving the jth whole-plot treat- 
ment and the kth split-plot treatment, 

S; = total of the available observations receiving the jth whole-plot 
treatment. 

The rules which determine the elements of A are: 

(i) (r—1)(s—1) for the missing observation under consideration, 

(ii) (1-8) for the jk associates, 

(iii) (1—7) for the ij associates, 

(iv) 1 for the j associates, 

(v) 0 for the zero i, k and ik associates. 


A typical element of q is given by: 
rW,, + s1,,—S,- 


(2) Whole-plot treatments in at x t latin square 


Consider a ¢ x ¢ latin square to which whole-plot treatments are allotted at random, and 
further let s split-plot treatments be allotted within each whole plot. The analysis of variance 
is shown in Table 7. As before there are two error terms to be considered. 


Table 7. Analysis of variance for a split-plot design with whole-plot treatments 
arranged in a latin square 





























Source of variation D.F. Sum of squares 
Between rows (t¢—1) (R—-C) 
Between columns (¢—1) (K—-C) 
Between whole-plot treatments (A) (t—1) (S—C) 

Error (E;) |  (t—1) (t¢—2) (W-R-—K—S+2C) 

Ta ee aT ane sibel wat 

Total (#?—1) (W-C) 
Between split-plot treatments (B) | (s—1) (T-—C) 

AB interaction (t—1) (s—1) (I-S-—T+C) 
Error (£,,) t(t— 1) (s—1) (Z—W-I+S) 
Total (st? — 1) (Z—-—C) 

| 














Where Z = total sum of squares of split-plots, W = total sum of squares of whole plots, C = cor- 
rection for the mean, R = row sum of squares, K = column sum of squares, S = whole-plot treat- 


ment sum of squares, 7’ = split-plot treatment sum of squares, J = treatment combination sum of 
squares. 
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We denote an observation on each split-plot by Xj, (t,j,4 = 1, 2,...,¢; 1 = 1, 2,...,8), 
where i denotes the row, j the column, k the whole-plot treatment associated with the plot ij, 
and / the split-plot treatment. Let p split-plots be missing. 

The following associates only exist due to the restrictions on a latin-square design: 
zero, t,j, k,l, il, jl, kl, ijk. 

Case 1. If we wish to minimize the whole-plot error we ignore the available observations 
and estimate new whole-plot values using the formula for a latin-square design. 

Case 2. Let W;; = total of the available observations on the «jth plot, 

I. = total of the available observations receiving the kth whole-plot treat- 
ment and the /th split-plot treatment, 

S, = total of the available observations receiving the kth whole-plot 
treatment. 

The rules which determine the elements of A are: 

(i) (t—1)(s—1) for the missing observation under consideration, 

(ii) (1—¢) for the ijk associates, 

(iii) (1 —<s) for the kl associates, 

(iv) 1 for the k associates, 

(v) 0 for the zero, i, j, 1, il and jl associates. 

A typical element of q is given by tW,, + sJ,, —S,. 

The fact that the coefficient of some associates is zero in these split-plot designs allows the 
problem of solving the equations to be simplified in many cases. If the matrix A is written 
down ordering the elements in groups according to the j subscript for the randomized block 
design and the k subscript for the latin-square design a matrix of the form (7) is obtained. This 
consists of submatrices along the main diagonal, one corresponding to each j or k, and zeros 
elsewhere. As these submatrices may be separately inverted to give the required solution 
considerable reduction in the labour of computation results. Further, in many simple cases 
the missing observations may be fitted quite independently using the standard formula for 
one missing observation. The independence of missing values within whole plots in these 
designs has been pointed out previously by Pearce (1953). If an entire whole plot is missing 
the ¢ x t submatrix will have (7 — 1) (¢— 1) along the main diagonal and (1 —r) elsewhere. The 
sum of a row is zero, and thus the submatrix is singular and there is no straightforward 
solution to the equations. 

Example 2. Table 8 shows the results of a split-plot experiment where the whole-plot 
treatments are arranged in randomized blocks (r = 4; t = 5; s = 2). Missing values have 
been artificially chosen to provide the example. Table 9 is prepared from the data of Table 8 
in exactly the same way as described in Example 1, except that the subscripts have been 
ordered using the middle (j) subscript. From the matrix A it is seen that the estimation of 
X19; ANd Xy99 is independent of the estimation of x35 and 232. Thus instead of inverting 
a 4x 4 matrix we invert two 2 x 2 matrices, considerably simplifying the problem. 

The estimates are given by 


yor} _ 3-1 ms 

i ae a 4 lens 
and Ty30] _ 3 1 2-56 

| ne 1/| 1 4 [s 


Thus 29, = 1-19; ogg = 1°19; 259 = 1°43; egg = 1°73. 
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Table 8. The wet weight in mg (x) of embryonic chick tibiae after cultivation on a chemically 
defined medium containing different concentrations of glucose or mannose. Treatment 
numbers are placed in parentheses. The variate analysed is log 10x 
























































Whole-plot treatment 
. Hexose concentration (mg./ml.) 
Block Split-plot 
treatment 
0:5(1) | 1-0(2) 2-0 (3) 4-0 (4) 8-0 (5) 
NR at itt | eed Bos 
I Glucose (1) 0-88 | (#1423 = 1-19) 1-33 1-39 1-57 
Mannose (2) 0-78 1-15 (2432 = 1-43) 1-42 1-51 
II Glucose (1) 1-06 | 1-22 1-63 1-54 1-37 
Mannose (2) 1-09 | (Zag = 1-19) | (2232 = 1-73) 1-47 1-44 
III Glucose (1) 0-97 1-34 1-44 1-66 1-59 
Mannose (2) | 090 | 116 | 1-44 1-48 1-59 
| | | 
IV | Glucose (1) 1-09 | 1-21 | 1-16 1-50 | 1-48 
| Mannose (2) 1-07 1-32 | 1-36 1-41 1-41 
| | | | | 
Table 9. Calculation of A and q 
A q 
Subscripts | = 
| 121 | 222 | 132 | 232 Wi; | } S; 
feemaaieh ances leant alae teal 
elke Tavira Vas mata iin gti 7 ly 115 |) 877 | 7-40 
222 | eo ae ee 122 | 363 | 740 
. .. #4 Rb 1 ee 1:33 | 280 | 8:36 
232 0 | 0 | =I | | 1-63 | 2-80 8-36 
a b thea i aan |_ 
| | | | | 
| | r= 4 e=32 | -1 
| | | 











VIII. Mixrep-vP OBSERVATIONS 


Sometimes the identity of observations may be lost so that we only know their total. These 
are known as mixed-up values. Bose & Mahalanobis (1938) and Nair (1940) have discussed 
the analysis of randomized block and latin-square designs where some observations are 
mixed up, and they have shown that estimates may be obtained which minimize the error 
mean square. 

In the general case both missing and mixed-up values may occur. We may relate this to 
the previous sections by supposing that some of the p missing observations are not missing 
entirely, but that certain of them have been mixed up. Then the p missing values may be 
cornected by c relations of the form: 


Ypbj;X; = Uy (¢ = 1,2,....9;j = SS, x05 8) (9) 
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The coefficients of (9) are either 0 or 1. For example, if p = 5, and the missing values are 
Yq, Xq, Ly, Lz aNd X49, With 2, and a, and also x, and x1, mixed up and 2,; entirely missing, we 


have the relations: , 
0.%,+1.%,+ 1.a%+ 0.2%43+0. 249 = Uy 


To obtain estimates for the missing and mixed-up values we minimize the error mean 
square subject to the conditional equations (9). Although the coefficients of (9) are restricted 
to 0 and 1 to deal with the case of mixed-up values, this restriction is not essential in the 
following discussion. The problem will be treated generally in matrix notation. 

Equation (8) may be written: 

Bx = u, (10) 
where B is a p x c matrix of coefficients; each column of this matrix will contain one unit 
element and (c— 1) zero elements, x is a column vector of the p values to be estimated, u is 
a column vector of c mixed-up totals. 

If we introduce a column vector (2A/N) of c undetermined multipliers the Lagrange 
equations are given by 


2 rey Ug, «++, %py)} + 2A'(Bx—u) = O. 


Using the notation of equation (1) we find that 
2/N(x'A—q’)+2/N2’B = O, 
and after transposition and rearrangement 
Ax+B’A = q. (11) 


The values of the p missing values which minimize the error mean square are given by the 
simultaneous solution of (10) and (11). These two matrix equations may be combined to give 


$1 | - a) 
B:O A} ul’ 
the solution of which is given by: 


N-B8T 


Example 3. Suppose that in Example 2, x), and x3, have been confused and that the 
combined weights after transformation to logs is 2-50. Similarly, suppose that 29. and 2og2 
are also confused, and that the combined weight is 2-83. 

The matrix of coefficients is found to be 


3 
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Then the missing observations are given by 




















Pita 2 ae ee oo -17 74749 
Loos . 2 (‘9 27 =) “SP fem 
nae Fee oe oe ee oe 2-56 
oO Mi i a: oo er a ae 3-76 

AX ear re Poe. Se 2-50 
oe S gae Mk ae ee ee 


Thus 29; = 1-14; Xgo9 = 1-16; X59 = 1°36; Fogo = 1-67. 
I wish to thank Dr D. R. Cox for helpful comments on the draft of this paper.* 
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NOTE ON A THREE-DECISION TEST FOR COMPARING TWO 
BINOMIAL POPULATIONS 


By J. H. DARWIN 


Department of Scientific and Industrial Research, Wellington, 
New Zealand 


1. INTRODUCTION AND SUMMARY 


Suppose that in each of two processes there is a probability of an event happening and it is 
desired to compare these probabilities. Pairs of trials of these processes may be made in 
sequence and a test made on the results. There may be four possible outcomes of each pair of 
trials—the event may happen in both processes, in neither, or in only one. If the result of the 
test is to be that just one of the processes will be used in the future the first two outcomes are 
irrelevant. If the result of the test is to be that just one of the processes will be used in the 
future if it is markedly superior to the other, but that either may be used if they do not appear 
to differ importantly then all outcomes are relevant. 

In this paper we produce a test for this latter case. Another test of this kind has recently 
been described by Armitage (1957). He does not employ pairs of trials having the same 
outcome and consequently has a different form of test. Both his and our tests are truncated 
in the sense that a maximum number of pairs of trials is needed for each. 

When the probability of the same result for each process is well known, our test will require 
a smaller maximum number of pairs of trials for the same power, and the same probability 
of rejecting when true the null hypothesis that the processes are equally effective. A numeri- 
cal example of this is given. 

When this probability of the same result for each process is not known Armitage’s test is 
preferable since it does not depend on a knowledge of this probability. When, however, the 
tests are being used to compare a control process with a new process our test which, in its 
construction assumes some value of the probability of the same result, will be affected only 
favourably should the control value of this probability depart from the assumed value. 

The strongest connexion between our test and Armitage’s is that the boundaries which 
determine when our test stops are a special case of the boundaries required by his test. We 
use exact matrix theory to find the probabilities of the boundaries being crossed, anc. he uses 
approximate normal theory. For some comparative examples we calculated, the proba- 
bility given by this approximate theory differed from those given by the exact theory by at 
most 0-0015. 

We also give an approximate set of power contours which enable tests of our type to be 
constructed for any value of the power and of the probability of rejecting the null hypothesis 
when it is true. 


2. DERIVATION OF THE TEST 


Suppose the probabilities of the events happening are p, and p, for the two processes. 
Then in a pair of trials the probability of the event happening in the first process but not 

in the second is p,(1—p.) = 7, say. 

The probability of the same result in the two trials is p, p.+(1—,)(1—p,2) = 72, say. 








— 


—_— 


eR 


we 4 © MN 


a wm nm @> 4A & = et ee 


1 it is 
de in 
air of 
of the 
es are 
n the 


ppear 


ently 
same 
cated 


quire 
bility 


meri- 


test is 
r, the 
in its 
1 only 
1e. 

which 
t. We 
e uses 
roba- 
by at 


to be 
thesis 








—— 


~~ 





J. H. Darwin 107 


The probability of the event happening in the second process but not in the first is 
p.(1—p,) = 713, Say. 

We consider a variable y taking values 1, 0 and —1 for these three cases, respectively. 
Suppose m pairs of trials have been made in sequence and y(m) is the sum of the m values 
of y. We could imagine y(m) drawn on a graph as a function of m. Suppose y(0) = 3(n+ 1) 
where n is an odd integer, and suppose the probability that y(m) has the value Y :3 Py, ». 


Then 
PY, mst = 1 Py mtM2Py, m+3Py +1,m: (1) 


If y(m) crosses Y = 0 we shall suppose the first process is accepted as that to use in the future. 
If y(m) crosses Y = n+ 1 weshall suppose the second process is accepted. If y(m) has crossed 
neither of these boundaries when M pairs of trials have been made the processes will be 
regarded as equally acceptable for future use and the sequence stopped. We now wish to find 
values of M and n for which there is a high probability of a markedly superior process being 
accepted, and a high probability of either process being permitted in the future if there is the 
same probability of the event happening in each process. To find these values we solve the 
system (1) with Py_o m = Pris,m = 9 for all integers a and 6 greater than 0; i.e. for y(m) 
confined between 1 and n. The Py, ,, satisfy the matrix equation 


NT, Ms 
7, MN, Ts 
Fas -_ . . . . . . re. 
™ «Me, M3 
™ 72 
=D,P,, say, 


where P,,, is the vector of the Py, ,,. 
Suppose |D,,—AI| is called D,,(A). Then D,(A) satisfies the difference equation 
D,(A) = (7_—A) Dy_s(A) — 7 773Dy_2(A) 
with solution 
D,{(A) = (3[7—-A+{(72— r= 4, 773}4])"*1 — ($[72—-A-{(m,.—-AP- 4a, 775}*])"+1 : 
: {(7,—A)? — 47,715} 


It easily follows that the latent roots of D,, are 








rT 
Ay = M1, + 24/(m4 77g) C08 — (r = 1,2,...,). (3) 


It then follows that D,(A,) = (7771g)* sin [(w + 1) rm/(n + 1)]. 
The elements of the latent column vector C, corresponding to A, satisfy the equation 


110; + (q—A) Vj 44 +13 %j42 = O. 


It then follows that the jth element of C, is proportional to (—)/ D,_,(A,)/73; and, similarly, 
the jth element of the latent row vector R, corresponding to A, is proportional to 
Saat Dj_4(A,)/74. - 

A spectral resolution of the matrix D,, is then possible (see e.g. Bartlett 1955, p. 26) and we 
may write 


Dm = Sanat 


oR. (4) 
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The probability of y(m) crossing Y = 0 up to the time when M pairs of trials have been 
made, if y(m) has previously been between 1 and 2, is 


M-1 


n 
x Pum 73 = 73% & AMCs Fy, ynevl (Cr R,) 
m=0 m r=1 


2 ,\2"-) 2 1-AM | orn . oom 
= —— — ——— sin sin. 5 
ait) ran 1-A,) ont] 2 (5) 





Similarly, the probability of y(m) crossing the boundary Y = n+1 up to the time when 
M pairs of trials have been made, if y(m) has previously been between 1 and 1, is 
2 ()" n 1-AM rt rT 


73 








ee in”. 6 
n+1"2 r=1 1-A, eee S (6) 


The probability of y(m) crossing the line m = M between Y = 1 and Y = n without having 
previously crossed either Y = 0 or Y = n+1is 


2 Ts }(n—-1) m,\t"-D\ 2 AM orn. orm 
aa ae ae 7 
i ("(2) +m,(2) ) 3 singe sin 5 (7) 











3. CALCULATIONS AND DISCUSSION 


Values of M and n given in Table 1 have been found to satisfy these requirements: 
(i) For some 7, and for a value of 7,/77, greater than 1, the probability (6) was made equal 
to 0-95 or 0-80. (8) 
(ii) For the same 7, and for 7, = 7, the probability (7) was made equal to 0-95. (8’) 
That is, the probability of accepting, when true, the null hypothesis of no difference 
between the processes, is 0-95, and the power of the test when 7, and 7, differ is either 0-95 or 


Table 1. Distance between acceptance limits (n) and number of trials (M) 
which will ensure the power indicated, at the 5%, significance level 


—_— —— — — —— 

















| | 
Power | m,/m3(=S)=1-2| 14 | 16 | 1-8 | 20 | 2-5 3-0 
ae eae eee ah. | |_ | | 
| 
M, = 0-25 0-95 n 181 | 99 71 57 49 37 31 
| M 2200 656 340 | 2200 162 95 68 
| 0-80 n 141 17 55 45 (43) 37 29 25 


M 1336 399 206 136 (131) 96 59 43 
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0-80. The conditions (8) determine unique values of M and n. The range of 7/7, considered 
was | to 3. 

That value of n was chosen for which the difference between the values of M for which 
(i) and (ii) of (8) were satisfied was a minimum. Then for the sake of definiteness that value 
of M was taken for which the power was closest to 0-95 or 0-80. The two values of n given at 
one place under 77,/7, = 1-8 indicate that n = 43, M = 131 is the better choice, but n = 45, 
M = 136 has been put in for comparison with the lower figures in this column. 

The calculations were not as laborious as might be imagined, since in all cases at most six 
and usually three terms of the series in (7) had to be taken, and always for 7, > 73, (5) was 
negligible. 

In (6) 





2 n,(7 | ~Y |, sin (r7/(n + 1)) sin gra _ mint) 
rT 


n+l I-A, aD yo” (9) 


since this is the known probability of y(m) crossing Y = n+1 when J is infinite. We used 
this as a partial check on the sufficiency of the numbers of figures we were keeping. 

There are good approximations available to the probabilities (6) and (7). First, there is 
the normal approximation. In this y(/) for large M is taken as normally distributed with 
mean M(7,—7 3) and variance M(1—7,—(7,—73)*). The probability of y(m) crossing the 
boundary Y = n+1 before M pairs of trials have been made is found (after consideration of 
the paths that reach m = M with Y less than n+1 but which have previously crossed 
Y = n+1) to be 


a(n + (7,—73) M (n+ 1) (7-75) PF —3(n+1)—(a,—75) M 
1— — espa | | ees | (10) 








1—7,—(7,—73)" 
where F(x) -" e-42* da],/(27). (11) 


This result is quoted by Armitage (1957) from work by Bartlett (1946). We compared the 
powers it gave for the values of n and ./ given by the first part of the line for 7, = 0-75 in 
Table 1 with the powers given by the exact quantity (6) and in none of the seven cases was 
the difference as much as 0-0015. 
Another approach to an approximation is given by considering (7) directly. Because of 
(9) we may write (7) in the form 
1 (1-7) AM m . rn 
nos. ie oo Whee FS kel 














n+1* 1-A, n+1 2 


Now suppose for convenience we denote 7,/7, by S. Then, 





Pe pe JS rm 
1-A, = (1 m,)(1— 7400s”. ). (13) 


For small r and large n we may write this as 


1-7, ((1- iS) e+ 2/8 rr) 


(n+1) 1+8 i+8 2 








= = ((1- bad ig) mts F) (1 C-30 +e ) (14) 


(n+ 1)? 1+8 


(1—2,/8/(1+8)) (n+ 1)? + 4722?) ° 
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For the range of S considered, 3 to 1-2, 1 — 2./S8/(1+/8) goes from 0-8660 to 0-9959. For the 
values of n and r encountered this meant that the last factor of (14) departs from one by only 
a small amount. We only had to consider values of r less than 7 so that r had a range virtually 
independent of n. This means we may write the denominator of (12) approximately as 


> rm sin (4r7) 
rai (M+ 1)? (1—2,/8/(1+8) + 9°70?) 
This exhibits the denominator as a function of (nm + 1)? (1—2,/S/(1+8)) only. We shall use 
this approximation below. Again, M log A, for low r is approximately 
rn? 2M,/ (77,713) 
2(n + 2)? (12+ 24/(7,75)) 
= — M(1—7,) (1—2,/8/(1+8)) -—4M(1—7,)? (1—2./8/(1+8))? 
r°7?M(1—7) 2/8 
dint. Lath Bios oad ie - 17 
nei reg it —m)(l-2yS/(1+8))). (17) 
The two leading terms of (17) each have M and 7, occurring only in the combination 
M(1—7,). The remaining terms are proportional to 1 —2,/S/(1+8). In particular if S = 1, 
1—2,/8/(1+8) = 0, and the approximation given by the leading terms is especially good. 
We can in fact write approximately for (7) 
4 vy ¢™ 
tS ep de te 18 
(« pty ) (18) 
where f = 77M(1—7,)/(n+ 1)?. The value of f making (18) equal to 0-95 is 0-24557. 
Suppose now we have found M and n for the test to have a given power for a high value of 
7, say 0-75, and for S not equal to one. Then M log A,(0-75) for 7, = 0-75 will be larger than 
M, log A,(0-25) for 7, = 0-25 and M, = 4M because both the second-order approximations in 
(17) have a negative sign. However (M, — 1) log A,(0-25) — M, log A,(0-25) is approximately 
0-75(1—2/S8/(1 + 8)) + 270-75 ,/S/{(1 +8) (n+ 1)?} and this in our examples is of the same 
order as the second terms in (17). In fact a drop of only one or two from M, was needed to 
balance the negative terms. This explains why in Table 1, for fixed S and n we are able to 
achieve the same power when M(1—7,) is kepi approximately constant. 





(15) 





M log (7, + 2.(7713)) — (16) 





We may write the term r72M(1—7,) 2,/8 
2(n+1)P 1+8 
r2n®M (1 — 7) 2/8 
; mM (1—m)(,_(,_ 248 19 
of (17) a ainsi (~(1-TE5)): a 


The term in 1 — 2,/8/(1+8) of (19) is of the same order as the second-order term in (17). It 
now appears from (15), (17) and (19) that the power (the complement of (7)) is approximately 
a function of the two quantities 
M(1—7,) . 
pest at 7 20 
(ely? and (n+1)?(1—2,/S/(1+S)). (20) 
The second-order term in (17) and those neglected in (15) offset each other to some extent. 
If they are neglected we may, following (20), solve approximately for the M and n required 
by (8 i 
y (8), the equations M(1\—7,) 
- = = constant, 





“(n+ 
(n+ 1)?(1—2./S/(1+8)) = constant. 














19) 
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For the values of n and S from Table 1 for a power of 0-95 and for increasing n, 
(n+1)?(1—2./8/(1+8)) takes values 137-19, 139-33, 142-98, 140-23, 139-93, 139-87 and 
137-17. For a power of 0-80 the values are 90-57, 86-86, 82-58, 88-21, 84-65, 85-10 and 83-50. 

For 7, = 0-75, a power of 0-95 and for increasing , M(1—7,)/(n+1)? takes values 
0-0510, 0-0502, 0-0491, 0-0495, 0-0494, 0-0493 and 0-0499. For a power of 0-80 the values 
are 0-0488, 0-0497, 0-0506, 0-0487, 0-0497, 0-0494 and 0-0498. 

The variations in these quantities are caused partly by the influence of the term neglected 
in arriving at (20), but mainly by the fact that M and n have to be integers and n has to be 
odd. This means that the powers for the values of n and M given in the table are never 
exactly those stated. They diverge from them by up to four or five in the third place of 
decimals for low n and less for large n. 

We would not expect (20) to hold if S were to increase much beyond 3, since 2 ./8/(1+ 8) is 
starting to diverge too far from one for 1 — 2 ,/S/(1 +) to be considered small compared with 
one. ' 

4. COMPARISON WITH ARMITAGE’S TEST 
Armitage’s test has a given power for any fixed 7/7, regardless of the value of 7,. Our test 
has a given power for a fixed 7,/7, and a given value of 7,. If our test is designed for a given 
value of 7, and this turns out to be the correct value it can be expected that our test will 
require a smaller maximum number of observations for the same power. We give a numerical 
example of this. 

In his Table 5 is given the maximum number of pairs of trials with unequal results to give 
a power of 0-95 and a probability 0-05 of rejection of a true null hypothesis. To make the 
comparison with our test we divide this maximum number by 1 —7, to take account of the 
discarded pairs of trials in which the processes gave equal results. We may divide this 
number by our value of M corresponding to this value of 7,. The ratio then is roughly 
constant at 1-27. This represents, for this power and probability of rejection of a true null 
hypothesis, the relative total number of trials required by the two tests when the assumed 
7, is equal to the actual 77. 

Suppose, however, the true value of 7, differs from that assumed in the construction of our 
test. Then if the true value is bigger than that assumed the power will decrease, if it is smaller 
it will increase. We can make an estimate of how big the change in power is likely to be when 
7, varies, by recalling the approximate result (20). If this holds we can take any values of 
M and n and map the power function of the test by varying 7, and S. We have done this and 
present the result in Fig. 1. From this figure we can get approximate values of M and n for 
a test in which the power takes any value between 0-50 and 0-99 and the probability of 
acceptance of a true null hypothesis lies between 0-917 and 0-993. 

Fig. 1 shows that there may be a marked drop in power if 7, is much bigger than was 
assumed. This is a serious weakness of the test if there is no knowledge of the likely value. 
Then it will be safer to use Armitage’s test. 

However, we consider one case in which the lack of knowledge of 7, may prove no bar to 
the use of our test. Suppose we are comparing a standard process of fairly well-known 
properties with an untried process. Suppose for the control process the probability of the 
event happening is P, and for the new process the probability is P,. By reversing if necessary 
the definition of the happening of the event determined by a process we may suppose P, is 
greater than one-half. An improvement on the control process may correspond to a value 
of P, either (a) greater than P,; or (6) less than P,. 
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We suppose (a) holds and that it is decided that an important improvement over control 
will correspond to values of P, greater than P}, say. The argument that follows will hold, 
mutatis mutandis, if (b) holds. The quantities P, and P, are enough to determine 7, and 
7,/73(= S) and so to give values M and n corresponding to any power and any level of 
rejection of a true null hypothesis. 

Consider what happens if P, is different from P3. If it decreases below P3, 


1, = P,P, +(1—P,) (1—P,) 


will decrease because P, is greater than one half, and 7,/7, = P,(1—P,)/{P,(1 — P,)} will also 
decrease. Because the power contours in Fig. 1 are convex these changes in 7, and 7/77 will 
have opposite effects on the power. However 1 — 7, is relatively a much more slowly varying 
quantity than 1 — 2 ,/S/(1+8) so that the proportional change in (nm + 1)? (1—2./S/(1+8)) is 
greater than that in M(1—7,)/(n+1)?. 
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Fig. 1. The approximate power of the test. 


We illustrate with two examples: 
(i) P,=0-6, Pi=0-7, P, = 0-65; 
then 1=7, = 0-46 changing to 0-47, whereas 1 — 2 ,/S/(1 +S) changes from 0-0239 to 0-0057. 
(ii) P, = 0-95, P,=0-98, P, = 0-97; 


then 1—7, = 0-068 changing to 0-077, whereas 1—2,/S/(1+8) changes from 0-1026 to 
0-0343. 

Suppose we were working with a 5% rejection level of the true null hypothesis, and 
a power of 0-95. Then for case (1) Fig. 1 shows that, approximately, the power drops to 
below 0-50 if P, is actually 0-65 instead of the required 0-7; and for case (2) the power drops 
to just above 0-5. One would, of course, naturally expect such a drop since an improvement 
from the control level 0-6 to 0-65 is not nearly as big as required. 

Suppose one were working with the more stringent levels of a 1 % rejection level of the true 
null hypothesis and a power of 0-99. Then for case (1) the power drops below 0-5, and for 
case (2) to round about 0-7. 

Conversely P, may be above P3. 
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Suppose we take (iii) P, = 0-6, P,=0-7, P, = 0-75; 
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then 1—7, changes from 0-46 to 0-45 and 1—2,/S/(1+8) changes from 0-0239 to 0-1339, 
For both the weaker and the stronger tests mentioned above, the power apparently increases 
to far beyond 0-99. Again, take 


(iv) P,= 0-95, Pi, =0-98, P, = 0-99; 


then 1—7, changes from 0-068 to 0-059 and 1 — 2,/S8/(1+8) changes from 0-1026 to 0-2649. 
For both the weaker and the stronger tests the power apparently increases to well beyond 
0-99, although, since S is just over 5 the approximations implicit in the construction of 
Fig. 1 are probably not very good. 

That is to say, in this familiar ‘treatment against control’ structure, the test appears to 
behave reasonably well. 


I am very grateful to Mrs Eleanor Burrell for doing a substantial part of the calculations. 
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EFFECT OF NON-NORMALITY ON THE POWER OF THE 
ANALYSIS OF VARIANCE TEST 


By A. B. L. SRIVASTAVA 
Indian Institute of Technology, Kharagpur 


1, INTRODUCTION 

A number of studies have been made of the effect of non-normality on the test functions used 
for the analysis of variance. The effect on Type I error, i.e. on the distribution under the null 
hypothesis, was studied by Pearson (1931), Geary (1947) and Gayen (1950), and that on 
Type II error, i.e. on the power function, has been considered in a study by David & Johnson 
(1951). Pearson showed that while both ‘ between-groups’ and ‘within-groups’ mean squares, 
in the case of non-normal variation, provide unbiased estimates of population variance, they 
are no longer independently distributed; in fact, their variances and covariance contain 
a term in A,.* However, he reached the conclusion that non-normality would not have 
a serious effect on the distribution of their ratio w, in large samples. Considering the effect of 
kurtosis only, Geary (1947) gave an approximate formula for the probability correction 
for w, based on the large sample assumption. Gayen (1950) derived the distribution of w for 
non-normal populations specified by the first four terms of the Edgeworth series. He found 
it to consist of corrective terms in A, and Aj in addition to the normal theory probability 
density function of w. Assuming that the observation x;; contains an error term e;; which has 
a distribution of any form whatever, with all the cumulants existing and varying from 
group to group, David & Johnson (1951) obtained the moments of the distribution of 
a certain function of the observations which makes the study of power possible in the non- 
normal case. They did not, however, make direct use of the distribution of a non-central 
variance-ratio as is done in the case of the ‘normal theory’ power function. 

Tang (1938) and Patnaik (1949) studied the power of the normal theory y?- and F-tests, 
by deriving the corresponding non-central distributions. The non-central distribution arises 
when the hypothesis of equal means is not true. The effect of non-normality on the power of 
the analysis of variance test can likewise be studied by investigating the non-central distribu- 
tion of the variance-ratio. This has been derived in the present paper, on the assumption that 
the distribution of the error term is represented by the first four terms of the Edgeworth 
series. In addition to the normal theory power (Tang, 1938), the corrective terms in Ag, Ay 
and Aj have been determined. In deriving conclusions we have kept in view the fact that only 
the values of A, and A, within certain limits (Barton & Dennis, 1952) can be permitted if the 
Edgeworth series is to represent a positive definite and unimodal frequency function. 

We have considered here the simple case of k groups of n observations. Gayen (1950) 
obtained the distribution of the variance-ratio assuming unequal number of observations 
in different groups, but we have avoided this assumption as it would necessitate introduction 
of more parameters of non-centrality and would make the results more complicated. The 
results obtained here enable one to calculate the effect of non-normality on the probability 
of the error of second kind, and hence on the power, when the standard F-table significance 
levels are used. The difficulty of having a systematic tabulation of the derived expression for 


* Here and below we use A, and A, to denote the standardized third and fourth cumulants of the 
variables. 
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the power arises from the fact that it contains confluent hypergeometric functions, which 
do not appear to have been tabulated so far in detail. 


2. DISTRIBUTION OF THE NON-CENTRAL VARIANCE-RATIO 

Let us consider k groups of observations 2;;(i = 1, 2,...,n;j7 = 1,2,...,k), and suppose that 
xj; =A+B;+e;;, (1) 

where A is the grand mean, B; the deviation of the jth group from the grand mean so that 

XB; = 0 and e,; represents the random residual distributed non-normally with mean zero, 

variance o? and standardized third and fourth cumulants A,(= /f,) and A,(= £,—3). 

Assuming the higher order cumulants to be zero, we can express the distribution of the 

standardized variable z;;( = e,;/0), by the first four terms the Edgeworth series as 


fle) = ote) —*2 412) +A ge) 473 gore (2) 


where ¢(z) is the standard normal function, and ¢™(z) its cal derivative. 
Now ‘between-groups’ and ‘within-groups’ sums of squares can be written as 


k k 
a ~ YG -z) =n ¥ @,—zZ+4,)%, where 3, = Bio (3) 
j=1 j= 
1 kon ss 
and lal > (x3 —%;)? = s > (is = z,)?. (4) 
j=li=1 j=1li=1 
In the analysis of variance, as is known, we test the hypothesis H, that 6; = 0 for allj, and 
use the distribution of w = [(N—k) X]/[(k—-1) Y] 


(with 6; = 0 for all j) in order to determine the point w, such that the probability P(w > wp) 
has a predetermined value a. We reject the hypothesis H, only if w > wp», and accept it 
otherwise. If H, is not true, we can determine from the distribution of w (with 6;’s not all 
zero), the probability of accepting H), that is, the probability of the error of second kind. 
Now, in order to obtain the power # = 1— Py, we first derive the non-central distribution 
of w. Let us put 


S,; = Dy +nd;, S. 23 = G52 z;)" (5) 
k 1k , 
_ xX, = > S,, Xo =— > S? (6) 
j=1 i 


so that X = X,—X}/N, where N = nk. 

Using the joint distribution of S,; and S,; which is obtained by replacing S,; by S,;— nd; 
in the result (2-11) of Gayen (1949), the joint characteristic function of X,, X,and Y has been 
derived as 

r exp {—4(Nt{— 2it,A)/(1— 2ite)} Tee “s 
P(ty ty, WU) = er Po(t,, ty, w) + — (1—2it, (1 —2iujya— {3AT 2+ 2729} 
k N-k 
aa ms pis Cs pT Be tbh ee D9 pr2 
rita (rt 1+ Wa—o8,) * Ma ws + UT 2722+ ae 


+3 3a(LWrts -3(N-+3) t+ 6]+ 5 [(k-+3)72)—(N + 3k)/N] 
6k 3(N —k) 3(N —k) 3(N —k) ) 


— 2it,) 


+ wa — ait? + NL — Bin) 47-9) + WA dia) A — 2a.) t NC — Dia? 


3(k+6) 3(N-—k 
+ 2UT1oTos (wrk —3(N +6)]+ ae : i we in) 





+ 187$9(A?7¥2 + 2vTy9) + 24AWT 2732 + syria} |. 
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it it 
where os (1 2it,)’ te = | (8) 


k k k 
=n>o?, w=n>do? and v=nydj* (9) 
I 1 1 


and where ¢,(t,, t., ~) denotes Gayen’s (1950) result (2°6)+, in which we have taken k’? = k’. 

Obtaining the joint frequency function of X,, X, and Y from (7) by Fourier’s inversion 
theorem, and integrating out X,, we find the joint frequency function of X and Y can be 
written in the form 


g(.,X, Y) = Jo(-.X, Y)+A39q,(-.X, Y)+Agga,(..X, Y)+A5gaz(..X, Y), (10) 


the typical term in it being d(Y,7r,) W(X, 72), (11) 

i y Yin-1e-tY 12 

waere (Y,7,) = anT(dr,) (12) 
—brA p-4X @ $r+3-1)i 

and sale ee Ea (13) 


24, 59 241 (dra +5) j! 
We can now deduce the frequency function of w = [(N —k) X]/[(k— 1) Y] from (10) in the 





a g(w) = gol) + Agga,(00) + Aaga(00) + ABGas( 0). (14) 
Using p(w; 7;, 72) to denote 
oo e-4A( Aji r,t wrniti-l 
Po ji Ban = hr.) Les ) v Bry +7y)+7 ” (15) 
(1 +— “t) 
Ve 

where vy, = k—1,v, = N—k are the degrees of freedom of X and Y, we find 
Jo(W) = P(W; Vy, V2), (16) 
Ja,(v) = ra Vy, V2) (17) 


Ja,(v) = say Vy + V2)? p(W; Vy, V2) — 204 (¥y + Vg) P(W; Vy + 2, Ve) 
+ vi p(w; vy +4, V2) — 29(V, + Ve) p(W; Vy, Vo + 2) + 20, Vo p(W; Vy + 2, V_+ 2) 
+ Vzp(W; Vy, V2 + 4)} + BAL — (Py + Pp) Po(W; My, V2) + Po(W; Vy + 2, V2) 
+ Ve p(w; Vy, ¥_+2)}+ Nvpy(w; V4, V2)], (18) 


1 
Jaz(w) = oy L8t- (Vy + Yq) (Vy + V2 — 1) p(w; Vy, Vz) + 3Y4(Yy + ¥2— 1) p(w; Vy + 2, Yo) 


— 3V4(V, — 1) p(w; Vy + 4, Vg) + 4(Vy — !) p(w; V1 + 6, V2) 

+ 3v2(V) + V2— 1) p(w; Vy, Vg + 2) — BY,» p(w; V+ 2, V2 + 2) 

— BV 9(V_— 1) p(w; Vy, V9 + 4) + 3Y, V2 p(W; Vy + 2, V2 + 4) 

+V_(Vq— Vy — 1) p(w; V4, V2 + 6)} + 18A{(Yy + ¥g— 1) po(w; V4, V2) 

— 2(v,— 1) po(w; vy + 2, Vg) + (Vy — 1) Po(W; Vy + 4, Vg) — 2g MQ(W; Vy, V2 + 2) 
+VqPo(W; Vy, Vq+4)} + 9A? — Nv) {p4(w; V4, Ye) — p4(w3 Vy + 2, V2)} 

+ Ny p(w; V4, Y2)], (19) 


* The conventional A, or non-central parameter, used here should not be confused with the stan- 
dardized cumulants, A, and A,, nor should v be confused with the degrees of freedom, v, and v2, defined 
below. 

+ In the first line of formula (2.6) of Gayen (1950), the factor (1—2¢t,)! in the denominator should 
read as (1 — 2it,)**. 
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where PAW; 1y,%2) = pP(W; 11+ 27, Tr.) —rp(w; 7, + 2r— 2, 72) 
r(r—1) 


+3 





p(w; ry + 2r—4,7r.)—...+(—1) p(w; 7,72). (20) 


3. POWER FUNCTION 
We are now in a position to evaluate the probability of the error of second kind P,, by inte- 
grating g(w) over the region of acceptance. If wy be the point which determines the critical 
region, we shall have 





Pyy(W) = [ g(w) dw = Py(W) + As Py,(Wo) + AgP,,(Wo) + AZPyz(Wo)- (21) 
In this, P,(w,) as obtained from (16), is given by 
et (3A)! : 
Py(wo) = De j! Ly(4¥1 +); $2); (22) 
j= 


where U9 = (k—1) wo/[(N —k) +(k—1) wo] and I, denotes the incomplete £-function. This is 
the normal-theory expression for P,;(w») and the methods of its evaluation have been 
discussed by Tang (1938) and Patnaik (1949). Here the expressions for P,,(w ), P,,(w») and 
P,;(wo) as obtained by integrating (17), (18) and (19), respectively, are expressible in terms 


of the confluent hypergeometric functions 


co > Le +j)T(b) x 
MOO XP O+IT@ i 

a Tr 
Writing F(a, b, 4Aup) = fect HT) F(a, b, 3AUp), (23) 


and F(a, b, $AUg) = Ko (a, b, $Aup) "C, Ug Koa 4 1, b a 1, $AUy) 
+... +(— 1) upho (a+r, b+r, Aug), 
F(a, b, fAug) = Ko (a, 6, $AUy) —"C,(1 — Up) Ko (a + 1, 6, fAuy) 
A = eee + ( a 1)" ( (1 ion ror chi b, $Auy), 


nth nt? a), 2s 


a ks J na uy) 


v3 Fy (35"* aos “2 , 3 ? au) - 27, 02K) ie a =—8, 3 » du, us) 
—2r mr Fg) (" =, “ * = ; tug) = V2Ko) (572 Ms nme 2 ? au)| 
+2 Ry (* ora 2 au) | (26) 


a a 9 “te Aug) 


VztVo Vv Vy+Ve Vv Ae 
+l 1) Ra" : > 4, t,t) — 1M [SF ( 5} 2+ uy) 


2 
+ Tey (51.3 eee OTT uo)} +3 (04-1) Fi (5 = oe 


on “1 Vyt+Vg Vy +2 


+ py (2578, =, data) +90? Nv) Fg fen 


(24) 
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If v, is an even integer, the above expressions can be reduced to the much simpler form of 


finite series by using the formula 

. Bia,r+1) x 
F(a+r,a,x) = e*F(—r,a, —2x) = 3 poset att 
For the normal-theory term, P,(w,), such an expression in the form of a finite series when v, 
is even, has already been given by Tang (1938). It is found that by using (28) the F,, and F,, 
functions occurring in the corrective terms yield expressions which are not difficult to 
evaluate for v, as large as 20. For example, in order to evaluate P,,(w») we have to calculate 


the value of F{4(v, + 2), $(v, + 2), $Auy)} which can be easily done by using the formula 
4v.—1 
Fo("* : 3, “1 _ : ’ uy) = ebruy > ies +¥2+ n uz 





(28) 














7 4S imo L\ H(¥2—2)-4 
4(v,+ V2) 4(vy + V2—2)\] (4Auy)? 
a, eee aa Ne 1 . 
a\ T'(a+1) 
i (; ~ PO+1) Pa—b+1) 


Similar expressions can be worked out for Fy, Fyy, Fey, Mig), etc., which occur in the equations 
(26) and (27), in order to simplify the computation of P,,(w9) and P,;(w») when v, is even. 


4. NUMERICAL EVALUATION OF RESULTS AND DISCUSSION 
We shall now consider numerical examples to illustrate the nature of the effects of non- 
normality on the power. It should be mentioned here that the formulae given above are 
useful only in determining the effects of such non-normality as is not of very serious type. 
However, a considerable range of values of A, and A, can be covered within the limits given 
by Barton & Dennis (1952) (see § 1 above). 

The values of P, (wo), P,,(wo) and P,;(wo) have been calculated for v, = 4,r, = 10 and 
v, = 4, v2 = 20 when the critical region is determined by the ‘normal theory’ upper 5% 
values of F and the alternatives are given by ¢ = ./(A/k) = 1-0, 1-5, 2-0, 2-5, ete. This 
critical region is, of course, based on an erroneous F’-value; the actual probability of Type I 
error, however, can be obtained by adding to 0-05 the corrections due to non-normality 
given by Gayen (1950)*. In the examples considered, since v, is even, it has been possible to 
use the finite series expansions for calculation. The values are given in Table 1. 

It is first necessary to examine what values ~ and v can take when A = k¢? has some fixed 
positive value. We have seen that the null-hypothesis H, assumes that 6;’s, the deviations of 
the group means from the grand mean, are all zero. If differences between groups exist, the 
6,’s will not be all zero and their set of values will define an alternative to H). In practice, the 
true values of group differences are not known, and one would depend on the parameters A, 
4 and v determined by 6,’s to define an alternative hypothesis. As indicated by Tang (1938) 


in an example, two extreme forms of the set of 6,’s under the restriction 5 6; = 0 will be as 
follows: 

(a) the k groups form two distinct equal sets (with a single group midway between if k is 
odd), the effects in one set being equal and opposite in sign to those in the other; 

(6) of the k groups, k — 1 are quite similar and only one is divergent, with its effect counter- 
balancing the rest. 

* There are a few slips in Gayen’s (1950, pp. 242) formulae (2°30) to (2°33 bis). There should be a 


minus sign before A, in (2-30) instead of the plus sign and in all the formulae from (2°31) to (2-33 bis) 
2» should be replaced by 1— 2p. 
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For a fixed A, in the case (a) the value of y will be zero and that of v will be minimum 
(= A?/N or kA?/[N(k—1)] according as k is even or odd). In the case (6), ~ will have an 
extreme positive or negative value (= +(k—2)A!/[N(k—1)]!) and v will be maximum 
(= (k?-3k+3)A?/[N(k—1)]). In practice the situation may be anywhere between these two 
extreme cases. 


Table 1. Showing the values of the corrective functions for a = 0-05 required in equation (21) 
when (i) v, = 4, v, = 10 and (it) v, = 4, v, = 20 














— 0-00000067 p? 


D.F | Powe) | Py, (“o) | Py,(o) | Pya(wo) 
| | ‘ 
v»,= 4 | 0-0 | 0-950 | o | 0-00376 | —0-00429 
v, = 10 | 1-0 | 0-738 | 0-0010750 ~ | ~—0-01273—0-0000744» | — 0-00480 —0-0000213 » 
| | + 0-00000604 yu? 
1-5 | 0-449 | 0-0002396 ~ | —0-01916—0-0000489 »y | — 0-00300 + 0-0000422 p 
| — 0-00000007 ? 
2-0 | 0-179 | —0-0001670 w | — 0-00156 —0-0000045 »v | —0-00390+0-0000157 v 


0-00944 + 0-0000047 » | —0-00174—0-0000008 v 
| | — 0-00000008 yu? 
3-0 | 0-006 | —0-0000239 7 | —-0-00495+0-0000015 » | — 0-00085—0-0000010 » 
| | + 0-00000002 yu? 

| 


2-5 | 0-043 —0-0001089 p | 








y,=4 | 00/0950) 0 | 000241 — 0-00096 
v, = 20 | 1-0 | 0-681 | 0-0018003 ~ | —0-01122—0-0001695 » 0-00273 — 0-0000038 v 
| 


15 | 0-341 | 0-0000834 ~ | —0-00929—0-0000818 » | —0-00159+0-0001133 » 
— 0-00000190 p? 
—0-00182 + 0-0000169 v 

—0-00000148 y? 
2-5 | 0-012 | —0-0000978 | 000458 + 0-0000074 » 0:00084 — 0-0000083 v 


| | + 0-00000006 ju? 


— 0-0003425 yw 0-00050 + 0-0000083 v 


| 
| 
| + 0-00001832 yi? 
| 
2-0 | 0-093 | 























N.B. The parameter A, 4 and v have been defined in equations (9). 


In Table 2, the values of P,,(wo), P,,(wo) and P,2(wp) (of Table 1) are given for the following 
cases: (a) ~ = 0, vy maximum; (b,) ~ maximum positive, vy minimum; and (6,) “ maximum 
negative, vy minimum. The sign of ~, which distinguishes case (b,) from (6,), only affects 
P,,(w 9). Where there are two signs with a value for case (b), the upper sign reites to (6,). 
The values tabled are expected to be correct to five places of decimals. 

In the examples, the effects of A;, A, and Aj are observed generally in the third place of 
decimals but sometimes in the second place. The effect of A, is, in general, higher than that 
of A; or Aj. Also it appears that the values of P,,(wo), a8 well as of P,3(w), are not much dif- 
ferent in the cases (a) and (b). 

We must now compute the power of the test in the case of non-normal populations with 
given values of A; and A,. In Table 3, such comparison is given for the examples considered 
above. Here the two entries before any value of ¢ in a column with A, = 0 correspond to the 
cases (a) and (b), respectively, and the three entries for A, + 0, correspond to the casess (a), 
(b,) and (b,). It is to be noted that the values for the cases (b,) and (b,) will interchange as A, 
changes sign. 









Table 2. Giving the values of P,,(wo), P,,(wo) and P,z(wo) (of Table 1) 


in the cases (a), (b,) and (b,) 


The power of the analysis of variance test 




















































vy, = 4,», = 10 Vv, = 4, ¥, = 20 
¢ Case 
P,,(o) Py, (wo) P,3(W) Py, (Wo) Py,(o) P)3(Wo) 

0-0 0 0-00376 — 0-:00429 0 0-06241 — 0-00096 
1:0 (a) 0 — 0-01289 0-00476 0 — 0-01143 0-00273 

(b) + 0-00465 — 0-01313 0-00479 + 000604 —0-01177 0-00293 
1-5 (a) 0 — 0-01968 — 0-00345 0 — 0-00981 — 0:00087 

(b) + 0-00350 — 0-02050 — 0-00415 + 0-00094 — 0-01064 0-00003 
2-0 (a) 0 —0-00171 — 0-00338 0 — 000067 — 0-:00148 

(b) ¥ 0-00579 — 0-00195 — 0-00334 F 0-00919 0-00093 — 0-00201 
2-5 (a) 0 0-00982 — 0-00181 0 0-00494 0-00058 

(b) F 0-00737 0-01043 — 0-:00228 F 0-00502 0-00552 0-00032 
3-0 (a) 0 0-00520 0-00068 _— — a 

(b) F 0-00279 0-00561 0-00068 —_ —_ a 

| 




















Fig. 1. Showing comparison of powers. —, normal; - - - -, non-normal (A; = 0, A, = 2-4). 


Values of d= /(A/5) 
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Table 3. Showing comparison of powers of the F-test in normal and non-normal cases 


A. B. L. Srivastava 


when using the normal theory with 5% significance level 
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It is again seen that when A, = 0 there is practically no difference between the values of 
power in the situations (a) and (b). When A, + 0, in the three situations (a), (b,) and (b,) that 
arise, the powers differ to some extent though not very significantly from the practical point 
of view. The situation (a), in this case, gives rise to values which are generally intermediate 
between those of (b,) and (b,). 














































































































Symmetrical distributions, A, = 0-0 Skew distributions, A, = 0-5 A; = 0-7 
d 
,=—1-0]A,=0-0| A, = 0-5 | A, = 1-0| A, = 2-0] Ay = 2-4 JA, = — 1-0] A, = 0-0 | Ay = 0-5 | A, = 2-0] A, = 2-4 
Case (i) vy; = 4, vy, = 10 
0| 0-054 | 0-050 | 0-048 | 0-046 | 0-042 | 0-041 | 0-055 | 0-051 | 0-049 | 0-044 | 0-043 
0) 0-249 | 0-262 | 0-268 | 0-275 | 0-288 | 0-290 | 0-248 | 0-261 | 0-267 | 0-287 | 0-291 
| 249 | — | -269 | -275 | -288 294 +245 -258 +265 +285 +288 
| | +250 -263 -270 -289 +294 
15| 0-531 | 0-551 | 0-561 | 0-571 | 0-590 | 0-598 | 0-532 | 0-552 | 0-562 | 0-591 | 0-600 
aL oe 561 “572 592 -600 -530 -550 -566 591 -600 
| | 533 “554 564 +595 605 
10} 0-819 | 0-821 | 0.822 | 0-823 | 0-824 | 0825 | 0-820 | 0-822 | 0-823 | 0-825 | 0-827 
“819 $s 822 -823 825 826 +823 +825 +826 -829 -831 
-817 “819 -820 -823 +823 
25| 0-967 | 0-957 | 0-952 | 0-947 | 0-937 | 0-933 | 0-967 | 0-957 | 0-953 | 0-938 | 0-934 
| +967 ‘. 952 947 -936 932 972 961 956 -940 -938 
| 964 954 949 933 -928 
30! 0-999 | 0-994 | 0-991 | 0-989 | 0-984 | 0-982 | 0-999 | 0-994 | 0-991 | 0-983 | 0-981 
fii aioe an 991 -988 -983 981 -999 995 -992 984 -982 
| 998 992 | -990 | -981 | -978 
Case (ii) y; = 4, v, = 20 

0| 0-052 | 0-050 | 0-049 | 0-048 | 0-045 | 0-044 | 0-053 | 0-050 | 0-049 | 0-045 | 0-045 
10} 0-308 | 0-319 | 0-325 | 0-330 | 0-342 | 0:346 | 0-307 | 0-318 | 0-324 | 0-341 | 0-345 
| -307 oo +325 331 +343 “347 303 “315 321 -339 342 
| -310 321 +327 “345 “350 
15; 0-649 | 0-659 | 0-664 | 0-669 | 0-679 | 0-683 | 0-649 | 0-659 | 0-664 | 0-679 | 0-683 
+648 oe -664 -670 -680 685 -648 -658 664 -680 -684 
| 649 659 665 681 685 
20! 0-908 | 0-907 | 0-907 | 0-906 | 0-906 | 0-905 | 0-908 | 0-907 | 0-907 | 0-906 | 0-906 
| 908 oe -907 -906 905 905 913 912 | -912 910 912 
| | 904 903 | -902 901 -899 
25/ 0-993 | 0-988 | 0-986 | 0-983 | 0-978 | 0-976 | 0-993 | 0-988 | 0-985 | 0-978 | 0-976 
994 | — | -985 982 | -977 | -975 -996 -990 -988 ‘979 -978 
| | | ‘991 985 | -983 “974 ‘971 

| | 
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Power curves relating to the symmetric lepto-kurtic population with A, = 2-4 (2, = 5-4) 
have been drawn in Fig. 1 along with the ‘normal theory’ power curves for the cases 
v, = 4,v, = 10and py, = 4, v, = 20. This diagram illustrates the nature and magnitude of the 
effect of such a departure from normality in the distribution of the random residuals. Pcwer 
curvesin the case of the other non-normal populations considered in Table 3 would differ 1:om 
normal theory to a less extent. 

5. CONCLUSION 

Obtaining the expressions for the power function of the analysis of variance test for a one- 
way classification in the case where the sampled population is represented by the first four 
terms of an Edgeworth series, we have considered certain numerical examples to see what 
is the nature of effects of non-normality on the power. The populations considered are only 
moderately non-normal, as the terms higher than the fourth in the Edgeworth series are 
assumed to be zero. Also the values of A, and A, have not been allowed to exceed the Barton 
& Dennis (1952) limits, ensuring thereby that the frequency function represented is positive 
definite and unimodal. 

It is found that the effect of skewness is not much on the power of the analysis of variance 
test, at least when the values of A, are confined to Barton & Dennis limits. In practice, 
however, higher values of A, may occur and then the effect of skewness may be somewhat 
larger and comparable to that of kurtosis which is, in general, high. The presence of a fair 
degree of kurtosis, as is not uncommon in practice, leads to a noticeable change in the power 
curve particularly in the case of small samples. But a small departure from normality in 
respect of kurtosis (say, of the order A, = + 0-5) again does not cause any significant de- 
viation in the power. When the population is leptokurtic (A, > 0), the power increases in the 
beginning (for example, up to the point for which the power is approximately 0-8 in the case 
when v, = 4, vy, = 10 (Fig. 1)), but in the region of very high power, it subsequently decreases 
in comparison with the normal-theory power. The reverse happens when A, is negative. 

The above conclusions derived from numerical results are expected to be valid in general. 
There is a good indication that the effect of non-normality on the power diminishes with 
increasing sample size, as expected. In practice the effect of kurtosis is likely to be more on 
the power than that of skewness. A general conclusion in this regard cannot, however, be 
given, for it is difficult to take into account all the ways in which the values of A, and A, of 
the distributions met in practice will vary. But on the whole it may be said that from the 
practical point of view, the effect of non-normality on power will not be of much consequence 
in the case of near-normal populations. 


My thanks are due to Dr A. K. Gayen for his help and guidance in the course of preparation 
of this work. I am also grateful to Prof. E. 8. Pearson for certain comments and suggestions 
leading to some improvement of the paper. 
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THE z-TEST AND SYMMETRICALLY DISTRIBUTED 
RANDOM VARIABLES 


By F. N. DAVID* 
University College London and Statistical Laboratory, University of California, Berkeley 


Some years ago in two papers (David & Johnson 1p516, 1952) the exact cumulants and 
cross-cumulants of the distributions of the sums of sqiares usually associated as test criteria 
for the general linear hypothesis were given under exttemely wide assumptions. It had been 
the intention, at this stage, to substitute in the given formulae the expressions associated 
with each of the analysis of variance set-ups and thus, by taking appropriate numerical 
values, to obtain some idea of the effect of non-normality, with and without unequal group 
frequencies, on the F-test as commonly applied. The arithmetic, however, proved formidable 
and an algebraic alternative was sought for. This algebraic alternative has proved of use in 
other problems not associated with the general linear hypothesis. It is proposed therefore to 
summarize it here and to illustrate its use on the F-test of the one-way classification, the 
non-normality of which has previously been discussed by Pearson (1931), David & Johnson 
(1951a), and Gayen (1950). It is hoped to present similar formulae using the cumulants 
for the general linear hypothesis sums of squares in a further publication. 


Assume k groups containing 7, 9, ...,;, observations with 
k 
y % = n. 


t=1 
In commonly used notation, the gpa: classification leads to the identity 
k 


k nm 
2 Ml, —%, J+ , z (%;—-%,,)? = = = (1%, —%,,)?. 


t=1 i=1 t=1 
Usually the x’s are assumed each to follow the same ened distribution. We shall assume 
that each has the same symmetrical distribution. There are no real difficulties introduced b: 
still further generalizing the situation and assuming for each group that x has a different 
asymmetrical distribution. The purpose here however is one of method and the symmetrical 
distribution leads to shortening of the expressions for cumulants. If 


k k m 
8,= > n(%,-Z,)? and S,= > > (%-%,,)*, 


t=1 t=1 i=1 
then we may write down the cumulants and cross-cumulants of S, and S, from those already 
given by David & Johnson (1951a). We have that 


E(8,) = (kK—1) kg =fi ke, (Sg) = (n—k) ky = fyky. 





on eis 
We define — Kerth? 
S?¢ S$) 
K(S?¢ S$ om __K(STS3) 
K(StS8) = (25,))4 (e( SV) 
a n° ¥ (m—1)% (, _ m)° 
and Vabe = (n — k)* koH1-a-< ( — iy n? (1 m) , 


* 
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124 The z-test and symmetrically distributed random variables 
It will be noticed that V,,, = 1 when n, = n/k,t = 1,2, ...,k. From the printed cumulants we Pre 
get, putting the odd gammas zero, and rearranging frec 
V Vy. V nor 
K (St) = Y2 wma K(S8,S_) = y22™, K(S3) = yo +5, bet 
1 ed nfs 
V, V, 
K(S}) = yy + 12y, V+, 
( i) Yan Y2 mh; +7 
In 1 
V, V, 
K (S782) = Y4 my + 42 af’ 
V, V, 
K(S,83 + 
(S,S2) = Y4 n2 2nfs ‘ie 
Vis Vary , 8 
K(S3) = y. a2 + 12 0+. 
( 2) V4 Y2 nf. fz 
V, A 32K Vor . 48 
K(S#) ie Ye “3 + 2474 aap t V2 ——* 144y, nf? fe — 
nf nf fi 
V, V, 12V, V, If 
3 18 122 122 111 
K(S} 82) = Ye7 nap + 7 nf, + 24y, nf?’ gen 
V, V, 12. 4V, 16y,V, 
K(S?83) = + Ay, 1 :( 112 mt) 4 20111 
am) = Ye “nfs fe = if, fife fi fe 
V, a Vee, 2, 
K(S,S8) = Yo Bt + 27a Be + dh (Tt — Sa) 4 aay, 
| for 
os Vaso 9 Vaso 6V 320 30a, 1 Varo 48 ‘ 
RUS) = ree + raat +O (eet) + Mt a i= 
Fis 
These expressions are all exact except that, in the first three cumulants of the fourth order, | om 
terms in y3 which were of order n-4 and n-5 have been omitted. } - 
Fisher and Cornish in their paper dealing with the inversion of Edgeworth’s expansion 
showed that the cumulative function of 
z=tlogF a4 
could be adequately represented in the normal case by the expansion which they obtained. Wi 
Thus if the cumulants of normal z, say zy are K,y, Koy, ..-,K,y,--. and the normal curve 
generating the expansion is allowed to have the same mean and variance as zy, we have that 
the standardized deviation from the unit normal deviate £, say, of the percentage point, is 3 
given by ti ’ 
Zy—-K io 
“Neat E = Wale 1) + dal E86) — dyl8(28°— 58) +. bi 
Ken 





where L= Arn (r > 2). 


Ky 
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Provided the moments of z are not greatly affected by non-normality or by unequal group 
frequencies there is no reason why a Fisher—Cornish expansion should not be adequate in the 
non-normal case. We shall assume therefore that the departures are of such order for this to 
be true. If L,, L,, ... refer to non-normal z, z4 (say), then let 














a, 914 "in Kea Ken Kr 
, L== iL,= r>2 
(Key)t Key ; (kay)? , 
In this case the Fisher—Cornish expansion is 
Z4—K 
©A MIN _ £ = Ty + §Lg(E2— 1) + Hak + sig Da( £2 — 36) — Fg 3( 26° — 58) +. 
VKen 
Hence by subtraction 
24—*n _ “14 — "in +8 | (Ko4 — Key) 4 (> — 1%) (= 2) 
Ken [Ken a) Kan 6 Kent 
PA in: 36) Ka4— Kan 1 rc K34 ma] 
a oF —-_§$——| +.... 1 
24 KBy #0 (26°— 56) K3N mn - 


If desired the cumulants of zy can be found from the differentiation of the cumulant 
generating function (see, for example, Wishart (1947)) 


are ee 





=)| — 4irlog (4. 


log (48 F—")| + 10g (#>*)| + ditlog (bh) 


for the polygamma functions are well tabulated, but this is not really necessary for the 
difference. We also note that zy is the tabulated percentage point of z, given, for instance, in 
Fisher and Yates’ Tables. z, can therefore be obtained provided the differences of the 
cumulants of z., and zy are known to a sufficient order of approximation. kK, is of order n~1 
and J, and L, are of order n!-4" when the group frequencies are equal. 


By definition | 
2z = log F = log (S,/f,) —log (S,/ f2) 
ne) GA 


Write 6, and 6, for reduced, standardized, S, and S,, respectively, and we have 
2z = (3, — dy) — (34 — 43) + §(01 — 83) — }(5 — 83) + 


6, and 4, are the two quantities the cumulants of which were given earlier. Taking expecta- 
tions and remembering that those terms remaining when the y’s are put equal to zero are 
those belonging to twice the mean value of normal z we have 


y Y. 3 he . 
Sie~ilae © — 23 Kor2— Vaso) + Gy2 (Vows — Vyo9) — 3H (Wt) Vaio) + +28 Bs (“us nat) 
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to order n-*. Following the usual procedure we obtain for the higher cumulants, We 


(Voos — Vis — Voor + Voo0) Vave 


Ke4—Kon = ino 2Vi11 + Var) +) — may = 
4n 4n 


$ Vere + $V 10 — 2Vias Yrs — 2Viaa Varo — Vins) 


+20(6 
oa (lanl 5 +7,) Yan 7 +7))| 
~ 2 (Tana +7) +a 4.7, seh 
ag — Kay = 24 (Vous — 2¥ jon + 3¥ea1 — Veo) — 2 1 (Veae — Veae) (Vers + Veno— 2¥ an) + For 
34 - | iia 8n2 023 122 221 320 8 n2 012 210 012 210 111 errs 








If } 
Kg4—Kgy = To (Voaa — 4Visg + Voge — 4Vga1 + Vaso) 

+ ran (Voos( — 5Voa2 + 6Via1 — Varo) + Vea0( — 5Var0 + 6Vira — Mazo) wh 
+ Vio0( 9Vo12 — 3Vor9 — 6Vj31) + Veo1(9Ve10 — 3Vor2 — 8Via)) = 
+ B. (5 Vine + 5 Vix0 + 2 Vina + 3V 11 (Vora + Varo) be 
) 

— 12Vj3,(Vore + Vix0) + 6Vir1 Vero ors) } 

3 6 
Vina (7.7) + Yan (7,3) + Ying 7) | 
+H5( “AF "A Th 

Th 


Ay ; Al ‘) 
re ES a a 4Vo05 — 6Vioo + 9V, 
2Qn2 fi 012 111) ji 210 in)? + fa 023 122 at > 


1 n 
af (6¥520— 14V 59) + Van 5 ) + RR 7 (#7 3Var0 +r). 


The second and third cumulants are of order n~* and the fourth is of order n-*. 
If the numbers in the groups are all equal, the V’s are all unity and considerable simplifica- 
tion results. We have 


l | 
Ko4—Ken = -21(5+ “) +e. 
K34—Kgy = O+... 
pre ee ie! Oe Re ee FB 
a a ee ae 27 fi fp ff, fi fi 
It is possible to rewrite the moments in a slightly different way which will bring out more 


strongly the variability of the group frequencies and the effect which it hasonthe moments _ 

of z. Let, for i = 1, 2,...,k, 
n 

nN; => i + Aj; 


k 
> A? = kvar(n,;) = kv 
i=1 





(say). 
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We take the ole for V,,,, substitute for n;, and expand to get 
ack? ke k?  abk? oF 


_ Ree, | Ree aoa Ghee cdl 
Vave— 1 o|ser75 7 "ih le bat Cont af, af, 


ks one ks ks 
+ 0) | gO MOC a ag MCaga HNO Oise 
ks 
Osa — ONC +0, feed 
vk* ks 
For example Vin 1 = “aR we ) 


If k = 5 and n = 20 this gives us 


5 
Au-l= — {99" + 79g /3(") 


which suggests that for all but widely different group frequencies the first term involving v 
will be adequate, and this is so in fact. We therefore substitute for V,,, and collect terms 
which enables the effect of the unequal group frequencies, as described by their variance, to 
be seen immediately. 


- 4, = (7) 
B= (G+7). 


Then on substitution for V,,,, we have 


k?A,v A, vk n kA 
Ky4—Kin = _™ a +(e +54 nt (vA. —3724As+Yez As) - arial + tee 


keBey | B, _ vk?B? vk 
Kea— Ky = PS * — + Sat (7 2¥4t 872) + F5Ye( Bi By— Ay As) 


PHA on op p48). 

















4n8 fife 4 
k* 19 2 
K34—K3n = — pe" Bi Aeyet 
3 VsV2 kK 
a ae a ae abe v? 





+ on) on Ma) 
+3a(- ‘Geljetesten-t) 
mF a a ee late 


“palin ih’ x eA) +8 (ae #4): 


When v = 0, that is when all the numbers in the groups are equal, the cumulants reduce to 
those previously noted. 
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We consider the case of equal group frequencies first. Refer to equation (1), substitute in 
the cumulant differences and collect terms of like order. The difference between the tabulated 
value of z and that of non-normal z is to order n-? and for k reasonably large 


5B) § (5) 4S” [n( 2 8 In n ") %e/ . 3 on 
——, 3(=4) 2+(> — ~2-St+5y tet) +l -F- Stee}. 
V2n\k} 2 \B) nP 24 "\ A fe fhe fi fi) * 2 fi fe file 

On the whole this correction is not large. For n = 20, k = 5 it is ' (2) 


tm é 0-020 + Jy (E3 — 3£) (3 0-063 + y, 0-010) 





while for n = 20 and k = 10 itis 
—V2 : 0-015 + ox (é* — 3£) (3 0-086 + y,0-013). 


For the sake of illustration consider the rectangle, where y, = — 1-2, y, = 48/7. The altera- 
tions to the tabulated percentage points are as follows 





| 
Degrees of Normal | Cor- Normal | Cor- 

freedom ae | rection | 2.9) rection | 

RE ARE UCR Fh ice | 

| 

i,=4i,,= 8 0-559 | 0-016 0-794 | 0-066 | 

fi=%fe=10 | 0-553 0-011 | 0-799 | 0-072 | 
| 








The corrections are not, on the whole, large and are unlikely to cause serious error in the 
application of tests of significance. The stability of the 5°% significance level is worthy of 
note, since it has become apparent in many non-normal investigations. (See, fer example, 
Pearson and Merrington’s table 42 in Biometrika Tables for Statisticians.) 

It will be noticed that while the effect of non-normality with equal groups is to alter the 
mean and variance of normal z by terms of order n~* the effect of unequal group frequencies 
is to alter them by terms of order n~!. This means that it is no longer possible to expand 
about moments of zy since the Edgeworth expansion requires the assumption that the 
difference between the second cumulants of z, and z, is of order n-*. The simplest thing 
would seem to be therefore to expand the mean and variance of z, with unequal group 
frequencies (z*, say) about its own mean and variance, remembering that the cumulants of 
zy Which can be substituted are given by 


2kyy = log f.—log f, + Wahi) — Wasa) 

key = WA) +(—-I Ye bfe) (8 > 1), 
where yf is the digamma function and y*-! is its (s — 1)st differential. For moderate diver- 
gencies from the ideal equal group frequency situation, such as envisaged in the expansions 
for the moments in terms of v given earlier, it is clear from numerical calculation that the 
effect of these divergencies is to bring the mean and variance of 2*, back towards those of zy. 
The greatest contributions to the mean and to the variance are, in fact, 
rage (“F2" % 5h 

14* in—Y2\—Gn3s ~ dnk)’ 
keBiv B, 


Keae = Kent Yo ess ~ nk 
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It is suggested therefore that calculations for the case when the group frequencies are equal, 
ie. when v = 0, will give a reasonable idea of the magnitude of the error involved if there is 
non-normality. 

The purpose of this present note has been one of method, but E. S. Pearson has pointed 
out to me that Gayen (1950) also considered the F-test in the one-way classification in some 
detail. Gayen was concerned in his numerical examples with the effect on the nominal 
5 % F-level of non-normality and unequal group frequencies and his results are not therefore 
directly comparable with those obtained here. It is, however, possible to use the same tech- 
nique to obtain corrections to the tail areas as has been used above to obtain corrections to 
the percentage point. Thus if g(7) is the normal ordinate at 7, then for the equal groups case 
the correction to ; 3 

[seta 


_o (2m 
will be found to be, to order n-}, 





24 — P¥ ae 
9(n) |-3 (sean) 4 “ 1) Me, aul], (3) 


For reasonable sized k we may write this as 


Yo. (y®—3y)  (yg( 3 3. 6n\ 2F/ 2 8 12n nm? 
oat ae” mle (-—Z-nt ha) te (ER ER A 
Somewhat surprisingly, the major part of the correction does not appear to depend on the 
degrees of freedom, although these are implicit in 9; for 9 is equal to the standardized 
percentage point of zy, i.e. _ aylot)—Kyy 
s VKey 

The comparison with Gayen’s work is difficult in that he assumes for the parent population 
itself an Edgeworth series in which the terms involving y, (of the population) and yj are 
assumed not toexist. It would appear therefore that a comparison should only be made in the 
region in which the parent population of Gayen is positive definite, i.e. is capable of being 
a probability distribution. I have therefore chosen a Pearson Type VII for my population 
with y, = land y, = 10. [This is a t-distribution with 10d.f.] Let the degrees of freedom of 
the samples be f, = 8, f. = 12. Gayen’s table will give the correction to be made to the 0-05 
upper level as — 0-0030. Substitution in formula (3) gives the correction as — 0-002 (3). The 
corrections are therefore of the same order, and (3) can be used to obtain some idea of the 


error involved for any of the usual significance levels for reasonable k. 


I have to thank E. S. Pearson for pointing out errors in the original draft, and H. Scheffé 
whose remarks on the paucity of arithmetic spurred me into trying to remedy the situation. 
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APPROXIMATION TO THE DISTRIBUTION OF SAMPLE SIZE 
FOR SEQUENTIAL TESTS 


I. TESTS OF SIMPLE HYPOTHESES 


By D. H. BHATE 
University College London and Delhi School of Economics, New Delhi 


1. INTRODUCTION 


A. Wald (1943) developed a sequential probability ratio test for testing a simple hypothesis 
against a simple alternative. He gave approximate formulae for the sequential test pro- 
cedure, its average sample size, and the power of the test. He has also derived the asymptotic 
form of the distribution of the sample size. The actual distribution of the decisive sample 
number (D.s.N.) has proved difficult to determine. Kac (1945) gave the distribution of the 
D.S.N. for the test approximately equivalent to that for comparing two possible values for 
the mean of a Normal distribution, in terms of the latent roots of an integral equation. 
Darling & Siegert (1953) have given the distribution of the duration of an absorption process 
approximating the sequential procedure for testing the mean of a Normal population with 
known variance. But in practice it is rather difficult to evaluate the actual probability of 
reaching a decision at a specified value of n. Baker (1950) has studied the distribution of 
D.S.N. experimentally in a special case. Page (1954a) and Albert (1954) have also studied this 
problem, using Monte Carlo methods and similar techniques. Ramchandran (1954) has 
developed certain approximations to the distribution of the p.s.n. His method gives 
satisfactory results for small values, only, of n, because the errors of approximation accu- 
mulate with n. 

In this paper we shall derive general formulae for upper and lower bounds for the cumula- 
tive distribution of the D.s.N., and use them to estimate its approximate distribution. 


2. DEVELOPMENT OF THEORY 


2-1. Let f(x, 0) be the probability density function of a random variable x, depending on 
a parameter 0. A sequential procedure, for testing the hypothesis H,:0 = 0, against the 
alternative H,:0 = 0, (H, and H, may be either simple or composite) may be constructed as 
follows. 

Suppose that 2,, v5, ..., %; is a sequence of independent observations and that t;, a function 
of these x’s, is an appropriate test statistic. Then the sequential test procedure is based on 
a partition of the range of variation of t; into three mutually exclusive regions C;, A; and R;, 
using the following rule: 

(i) ift,eC,, take a further observation; 
(ii) ift;e A,, accept A); 

(ili) if t;¢ R,, reject Hy (i.e. accept H,). 

The regions are chosen in such a way that the probabilities of rejecting H, and H, when 
they are true are approximately « and £, respectively. 

Following this rule a decision is reached at the ith stage if t;eC; for j = 1,2,...,4—1, and 
either t;¢ A; or t;¢ R;. The argument used below to determine the upper and lower bounds 
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for the distribution of 1, the decisive sample number (D.s.N.) may be illustrated with the help 
of the accompanying diagram, in which j is taken as abscissa and ¢, as the ordinate. The 
boundaries between the regions have been represented by the lines O’A, and O’R (not 
necessarily straight lines). 






0’ Accept Ho 


> 


h 


Axis of t) 


ci 


Continue sampling eae | 
7 




















R, 
’ fi | 
a Axis of j 
Oo” 
Fig. 1 


2-2. Suppose now that although a decision is reached at stage 7 = i, sampling is continued 
to a fixed stage 7 = m (>i). In the diagram, two possible sequences of samples are repre- 
sented. Each track enters the acceptance region at j7 = i but in one case t,,€ A,, and in the 
other case t,, €C,,,. Similar sequences of samples when the track enters the rejection region at 
j = tare also possible. 

Now define the following probabilities. 

(a) P,, = probability that a decision is reached at, or before the mth state and 
tnEC, = P{t,éC,,}. 

(6) »; = probability that a decision is reached at the ith stage (and not before) 

=P{t;«C; for j=1,2,...,i-1 and t,cAj}+Pf{t,eC, for j =1,2,...,i-1 
and t;€R}=p,4+Pin (say). 

(c) p; = probability that a decision is reached at the ith stage (and not before), but that 

when sampling is continued to the mth stage, t,,€C,, 
=P{t,<«C,; for j=1,2,...,t-1,t;¢A, and t,,€C,} 
+Pf{t,«C; for j=1,2,...,.t-l,teR, and t,€C,,} 
=PiatPirn (say). 
The diagram may help to clarify the meaning of these probabilities. The continuous path 
wou.:! be included among those associated with p; , and P,, but not with p;,,; the broken path 
would be included among those associated with p;, and p,, but not with P,. 

Then it follows that a a2 

~ p;, = E+ = (Pia tPin)- (2-2-1) 


9-2 
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Thus P,, provides a lower limit for the cumulative distribution of the decisive sample 
number. By considering the upper bound for p}, and p;, we shall obtain an upper limit for 
the cumulative distribution of the pD.s.N. 


be the conditional probability density function of t;, given that no decision has been reached 


before the ith stage. 
Then 
Pia - | p,{t;)dt; and P= | p,(t;) dt;. 
te Aj eR; 
Further via= [rato [ | pital dy} at 
Ee Ai tmeCm 





where p(t,,/t;) is the conditional distribution of t,, given t;. If we write 


Nim = max { P(t |t;) dt, (2-2-2) 
teAy JtmEeCm 
it follows that Pia S rim | Pills) Ut; = NimPia- 
tie Ay 
Similarly if Sin = max [ P(t | t;) dt;. (2-2-3) 
tery JtmeCm 


Pir < SimPir- 
Hence from (2-2-1) we have the bounds 
™ m—1 m-1 
Pn < Py Pi f+ = Nim Pia t 2 SimPir (2-2-4) 
i= = ta 


The result is valid for any hypothesis H (not only for H, and H,). 
Two less sharp, but sometimes more easily calculable, inequalities can be derived from 
(2-2-4). These are 


™m m—1 

=X Pi < Pat = Pitim+emaxd;,, when A, is true, (2-2-5) 
i=1 i=l i,m 

™ m-1 j 

XP: < Ppt Pmaxyint+ YS Pidim When H, is true (2-2-6) 
i=1 i,m i=1 


We can use (2-2-4) to give useful upper and lower bounds for the cumulative distribution 
of p.3.N. if 9;,, and 4;,, can be evaluated, and, being evaluated, are sufficiently small. 

Just where, between these limits, the actual value of the cumulative distribution lies, we 
do not know, but in the examples which follow it appears that a simple average of the upper 
and the lower bounds gives quite good results. 


2-3. Consider now a special case of comparison of two simple hypotheses H,; H, and sup- 
pose that we know that, with an obvious notation 


p(y) = p,(A,). 


This is so, for example, when H, and H, specify two values for the mean of a Normal 
population, and a = f. 
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For all decisions to accept Hy, at sample size i 


P(x, ...,%; | Hy) < Fre -oap | Hi), 


80 Pia) < -f P;ia( Hp) 


and similarly Pir(A,) > ae Pir(A). 


Approximately (i.e. neglecting the amount by which the limits are overshot) the inequalities 
may be replaced by equalities, giving, when « = #, 
Pia) _ Pirlo) a 





PislHy) Pip) 1-a° 
Since Pia(A,) + Pin(Ah) = p(Ay) = pH) = Pi 4( Ho) + Pir(Ad): 
Pia() = ap, and p,4(Hy) = (1 oe (23-1) 
Pir(M,) = (1—-a)p;, and pip(Hy) = ap,. 


If (2-3-1) be assumed to be true we can proceed to use the inequalities (2-2-4). 




















Table 1 
| 
a c | 1 c a c 
a ee ee ee | a ees 
1 0-0860 | 6 0-0687 ll 0-0686 
2 -0778 | 7 -0686 12 0686 
3 -0710 | 8 -0686 13 0686 
4 -0693 | 9 -0686 14 0686 
5 -0688 | 10 -0686 15 0686 








In order to see how far this assumption is justified we quote figures obtained by quadrature 
in the course of the calculation of the exact distribution of the p.s.Nn. for the case 


1 
x |0) = —_. e-ha-0? 
ntl9) = Tan) 
H:90=0,=0, H,:0=0,=1; a=f=0-0758. 

(The common value 60-0758 for « and £ was chosen in Example 2 below, to give simple limits 

m 

fori. = > x,,) 

j=1 
The values of the ratio ¢ = p;(H,)/p;(H)) obtained in this calculation are given in table 1. 
Apart from some variation for small 7, when some excess of the observed statistic over the 
boundaries is to be expected, c = p;p(H))/p;(Hy) = 0-0686. Thus the assumption of constancy 
in the ratio may not be greatly in error, provided the probability of termination for 


i= 1,2,3,4, is fairly small (though the actual value of the ratio is rather less than the 
nominal value of «). 
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3. ILLUSTRATIVE EXAMPLES 

Example 1. Let 
2,0) = oe, 

H,: 0 = 0, = 0, ret 1; a= f = 0-025. 


(i) The continuation region at the mth stage, C,,, is defined by the inequalities 


0-025 -™ flwi,1) _ 10-025 
1—0-025 ~ A4f(z,,0) 0-025’ 








1 ™ 
or —log, 39 < <_ EY [(a;,-— 1)? -—23] < log, 39 
i=1 
i.e. —3-66+4m < t,, < 3-66+ 4m, 
m 
where tm = LY Ve 
i=1 
Similarly (ii) —3-66+4m >¢,, for region 4,,, 
(iii)  3-66+4m <t,, for region R,,. 


Denoting the probability density function of t,, by p(t,,), where in this case 


D(tn = ea) et 3(t,, —m0)?/m}, 
7: fg 
we have Yim = I P(t) dt nis 
4(m—-i) 


since this value corresponds to the case when ¢; is exactly on the boundary of C;. Similarly 


4(m-i) 
Sim _ { P(tn—i) Ut m_;- 


—7:32+4(m—i) 


The following Table 2 gives, when H, is true, the upper and lower bounds for the cumula- 
tive distribution of the D.s.N., using (2-2-4), and the average of these bounds. The observed 
frequencies in the last column are taken from an experimental investigation by Baker (1950). 

Comparing the theoretical frequencies Np; with Baker’s sampling results, we find that 

2 = 19-0022 with v = 20 p.F. (frequencies corresponding to i = 1 and 2 were grouped). 
Thus the somewhat arbitrary assumption that we may approximate to the cumulative sum 
of the p,’s by taking the mid-point between the upper and lower bounds is not disproved by 
these results. 


Example 2 


Let « = £ = 0-0758. This case has already been referred to in § 2. The regions C,,, A,,, RB, 


eae See Oe C,,: —2:50+ 4m < tm < 250+ 4m, 


A,,: —2-50+ 4m > t,, 
R,,: 250+ 4m < t,, 
The approximate distribution of the D.s.N. under H) can be calculated as in Example 1. 


In this case, an exact calculation by quadrature was also carried out. At each stage 
P-(tm), the conditional probability density function of t,,, given that no decision had been 
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reached up to and including the mth stage, was computed by quadrature. The distribution 
Of tinia = tm +%m 1 Was then computed from the formula 


Peltm+1) a | 0 Pelt) P(Xm+-1) dt», where em+1 io bmi — bn: 


The results of these calculations are shown in Table 3, together with some observed 
frequencies taken from the unpublished results of experiments carried out by Baker, who 
kindly put them at my disposal. 


Table 2. Estimation of p; for Example 1 and comparison with Baker’s empirical results 























with N = 2002 
| | | Expected 
Sample | Lower | Upper eat UNA Observed 
no.i | bound LZ, bound U; | HO.+L,) mn =H vor frequency 
| | 
| | | 
| ae | | | " 4 
1 | 000080 | 0-00080 0-00080 000080 | 2 0 
2 | -03055 -03080 -03068 -02988 | 60 60 
3 | -10709 -11680 *11194 -08126 163 140 
4 | *20560 *23914 22237 11043) | 221 217 
5 | *30451 +36645 +33548 *11311 226 213 
6 | 0-39684 | 0-48287 0-43985 0-10437 209 219 
7 | 47944 | +58289 -53116 -09131 183 193 
8 -55112 *66538 -60825 -07709 | 154 158 
9 | *61352 *73289 -67320 | 06495 130 125 
10 -66583 *78627 *72605 05285 | 106 112 
11 | 0-71173 | 0-82976 0-77074 0-:04469 89 99 
| 12 | *75438 *86839 *81138 “04064 81 85 
| 13 -78764 *89726 84245 | -03107 62 63 
14 *81545 “91855 -86700 *02455 49 54 
15 -84090 -93667 *88878 -02178 44 43 
16 | 0-86174 | 0-95062 0-90618 0-01740 35 41 
17 *88059 -96231 *92145 -01527 31 21 
18 *89761 -97263 *93512 -01367 27 37 
19 -91114 -98000 *94557 -61045 21 26 
20 | *92334 -98592 -95463 -00906 18 15 
21-25 0-93419 — —- 002807 56 54 
> 25 -96838 —- -— -01730 | 35 27 | 




















Comparing the approximate expected frequencies Vf; and the exact expected frequencies 
Np, with the observed frequencies we find that x? = 18-7304 and x? = 13-4573, respectively, 
for vy = 16. Thus we find that there is agreement between the expected and the observed 
frequencies. It is clear from this table that the approximate expected frequencies and 
the exact values of these frequencies agree well. This supports the assumption that 
we may approximate the cumulative distribution by the mean of the lower and upper 
bounds. 
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Table 3. Values p; obtained by (2-2-4) and by quadrature and 


their comparison with empirical results with N = 698 














Expected frequencies 
































. Approximate Exact 
Sample probabilities probabilties Observed 
no. Fy 2D; frequency 
t : ; ND; Np; 
1 0:02410 0-02410 17 17 17 
2 -13126 *13355 92 93 100 
3 *16425 -16311 115 114 111 
4 -14608 -14459 102 101 100 
5 -11702 *11725 82 82 94 
| 
6 0-09112 0-09257 64 65 66 
| 7 -07080 ‘07229 49 50 45 
8 -05613 -05628 39 39 37 
9 04326 04376 30 31 41 
| 10 ‘03489 ‘03399 24 24 18 
| 
| 11 0-:02796 0-02643 19 18 13 
| 12 *02258 -02052 16 14 12 
| 13 -01844 -01594 13 11 13 
14 -01526 -01238 ll 9 8 
15 -01236 -00963 9 7 7 
16 0-01026 0:00747 7 5 3 
>17 -01423 -02604 10 18 13 
Example 3 
Let x be a Normal variate with zero mean and variance o°. 
H:oc=o,=1, A:o=o,=3; a=f=0-01. 


The test procedure is then based on the following regions: 


In this case we cannot assume that p, ,/p; is approximately constant, but will use one of 
the bounds given by (2-2-5). We shall calculate the approximate distribution of the p.s.N. 


™m™ 
C,,: —10°350+2:475m < 3 


j=1 


3 


A,,: — 10-3504 2-475m > ¥ 


m 


R,,: 10-350 + 2-475m < 


j=1 


2 
j 


2 
Xj» 


aj. 


j=1 


under the null hypothesis, and will use the formula 





m—1 
iS Pat XD ViMimt+ & max bj, 
i=1 i,m 
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We find that max 4;,, is very nearly equal to 1 for a number of combinations of i and m 


and therefore we can simplify our calculations by calculating the bounds from the formula 


™m m—1 
Se < & Pi < ¥, + x Pilim + &, 
i= i= 


- seem ana 


where Nim = P(Xm—) dX ni 
2-475(m—i) 


m 
(since > 27 is distributed as x?,_; 0) : 
j=it+l 
The following table gives the approximate D.s.N. distribution, together with the upper 


and the lower bounds for the cumulative p.s.N. distribution from which the approximate 
distribution was obtained by averaging. 


Table 4. Estimation of p; for Example 3 














| 
| | 
| Sample Lower Upper | Mean of the | Approximate 
no. bound bound bounds probabilities 
| a L; U; | $(L,+U,) Di 
Se | 
5 0-13722 0-13722 | 0-13722 0-13722 
6 -39140 -41729 *40434 -26712 
bes aa -56689 -61939 | 59314 -18880 
8 -69340 -75623 | *72481 -13167 
| 9 -77997 -84338 | -81167 -08686 
| 
10 0-84448 0-90972 | 0-°87360 0-06193 
11 -88878 94038 91458 | -04098 
12 *91951 -96396 -94178 -02715 
| 13 *94342 -98146 | -96242 -02069 
| 14 -95838 -99105 | -97472 -01230 
> 15 0-96991 —- 1-00000 0-02528 
| | | 














The region A,, does not exist for values of m less than 5 and therefore decision to accept H, 
is not possible for these values of m; hence the above calculations are for values of m > 5. The 
probability p, contains, in addition to the probability of reaching a decision at m = 5, the 
probability of reaching a decision to reject H, at m = 1, 2,3 or 4 which is almost negligible. 


4. BOUNDS FOR THE AVERAGE SAMPLE NUMBER (A.S.N.) OF A SEQUENTIAL TEST 
If we write, abbreviating (2-2-4), 


m 
Pn < Pi < Pm 
i= 
then it is easy to show that, for sufficiently large N, 


beh pamealt ik N 
N+1-— ~ P< = jp; < N+1-— > FP, (4:1) 
m=1 j=1 m=1 
As N tends to infinity the central term in these inequalities tends to the A.s.N. of the test. 
In Table 5 the limits for the a.s.N. so obtained are compared with the limits given by Wald 


for the problems stated in Examples 1 and 2. 
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The experimental value 8-8 of the a.s.N. was taken from Baker (1950) and is based on the 
results of 2002 tests. The other experimental value 5-65 is based on the unpublished results 
of the 698 tests carried out by Baker. 

From this table we can see that the lower bound, given by (4-1), is sharper than that given 
by Wald, but that Wald gives the sharper upper bound. Hence, the lower bound in (4-1), 
and Wald’s upper bound, give narrower limits than either system alone. 


Table 5. Comparison of wpper and the lower bounds for the a.8.N. obtained by using Wald’s 
formula with those obtained using equation (4-1-1). Case Hj: 0 = 0; H,: 0=1 




















| | 
Risks | a = B= 0-025 | a = B = 0-0758 
| 
| Equati Equation 
Result obtained by ...| Wald a Expt. | Wald 4 Expt. Exact 
| (4-1-1) | (4-1-1) 
BD saa: ne bee See = 
| | | 
Lower bound | 6-9 7 6 | — | om” 494 | — — 
Approx.a.s.x. | 72 | 862 | 88 4:24 581 | 5:65 5-87 
Upper bound | 89 | 964 | — | 6-10 | 7-20 - 
| | | 











5. CONCLUSION 


Many of the results in this paper are valid for tests of composite hypothesis also. It is hoped 
to publish the results of similar investigations for composite hypothesis in the near future. 


The author wishes to thank Dr H. O. Hartley and Dr N. L. Johnson for their valuable 
suggestions and guidance, while the author was working in the Department of Statistics, 
University College London, and also the referee for suggestions and criticisms. 
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TOURNAMENTS AND PAIRED COMPARISONS* 


By H. A. DAVID 
Virginia Polytechnic Institute and University of Melbourne 


1. INTRODUCTION AND SUMMARY 


In an experiment involving paired comparisons ¢ ‘stimuli’ such as flavours or colours are 
presented in pairs to a panel of n judges. The basic experimental unit is the comparison of two 
stimuli by a single judge who must state which one he prefers. Such an individual paired 
comparison may be regarded as a game between two contestants—the stimuli—while the 
experiment as a whole is analogous to a tournament of ¢ players. If all the possible }¢(¢— 1) 
comparisons are made by each of the n judges, this corresponds to a Round Robin tourna- 
mentrepeated times. It will be convenient in this paper to use the language of tournaments 
rather than that of paired comparisons. 

The analogy between a paired comparison experiment and a Round Robin tournament, 
first pointed out by Kendall (1955), suggests the investigation of another well-known way of 
running competitions, the Knock-out tournament. It is perhaps surprising that such tourna- 
ments do not appear to have been studied at all in the statistical literature, although this may 
be due to their inherent lack of balance+. However, while this objection is valid if a ranking 
of all players is desired, it loses much of its force when the aim is to pick the best player. In 
§2 some properties of a simple (i.e. unrepeated) Knock-out tournament are investigated; 
in particular, an expression is found for the probability with which the best player wins 
such a tournament, various assumptions about the strengths of the players being made. 

Round Robin tournaments (in effect) have received considerable attention both from 
statisticians and psychometricians. One problem is the enumeration of the possible out- 
comes, expressed as scores, of a tournament of a given size and the determination of the 
frequencies of these outcomes. The matter has been investigated by Bradley & Terry (1952) 
and Bradley (1954) and is further considered in §3 and Table 1. Bradley & Terry have also 
proposed a model to represent the strengths 7; (i = 1, 2,...,¢; Xa; = 1) of the players which 
allows the 77; to be estimated from the players’ scores. A different model had been suggested 
earlier by Thurstone (1927). Tests of the over-all equality of scores may be based on these 
methods or on combinatorial arguments leading to a test criterion involving the sum of 
squares of the scores (Durbin, 1951). For a simple Round Robin tournament the latter 
approach is equivalent to the ‘circular triad test’ of Kendall & Babington Smith (1940). 

However, these approaches do not provide an answer to such questions as what constitutes 
a significant difference in the scores of two specified players. To deal with problems of this 
type, the joint probability distribution of the scores of any s( < t) players in a simple Round 
Robin tournament is found in § 3-1 on the hypothesis, H), that the players are all of equal 
strength. This result is used to obtain tests of significance based on what are essentially 
upper percentage points of (i) the score of a specified player, (ii) the difference in the scores 
of two specified players, and (iii) the top score in the tournament. 

Some aspects of repeated tournaments are discussed in § 4. 


* Research supported, in part, by the Office of Ordnance Research, U.S. Army. 
t [See, however, a paper by Rita J. Maurice (Biometrika (1958), 45, 581-6) published since this 
paper was written. Ep.]. 
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2. KNOCK-OUT TOURNAMENTS 


We suppose that the number ¢ of players has been reduced, by preliminary play-offs or 
otherwise, to a power of 2, say t = 2”. The tournament will then be completed in p rounds. 
If all contestants are of equal strength, each has probability t-! = 2-” of winning the tourna- 
ment; or, more briefly, each has winning probability 2-”. Likewise, if a particular player 
beats any one opponent with probability 7, he will win the tournament with probability 7°. 

In more complicated cases the winning probability of a specified player will evidently 
depend on the initial tournament draw, which we take to be strictly random. Let us call the 
t contestants C,,C,, ...,C,and write 


C,—-C, (i,j =1,2,...,t;9 +9), 


to express that C; defeats C; with probability 7. Let P{ (r = 1, 2, ...,) denote the proba- 
bility that C; reaches the rth round of the tournament and wins his game in this round, so that 
P‘?) is his probability of winning the tournament. Finally, let M$) be the probability that C; 
meets O; in the rth round and M;; be the probability of their meeting in the course of the 
tournament. Clearly 








M,, = 5 MY. (21) 
r=1 
Suppose now that Cy > Car Cy, «+25 Oy, 
Cy > Ca Cy, «+25 OG, 
C1 Ce 
Then C,’s probability of winning the tournament is given by 
PY = My™27P* + (1—Myp) 7. (2:2) 


If the draw is known, M,, and hence P{”) can be evaluated. Instead of considering this, we 
shall obtain expressions for M,, and P{”), the values of M,, and P{”) before the draw. These 
prior probabilities will still be linked by (2-2). We have 

MY = 1-1). 
If C, and C, are to meet in the second round, in which there will be 4¢ contestants, they must 
both be successful in the first round, so that 


Mi} = (1— M4) 7, 7,/(3t — 1) 
= 2n,7,|(t—1). 
Continuing the argument, we find 
Mi} = (27,7,)"/(t—1), 
an p 
and hence from (2-1) My, = ¥ (27, 7,)""3/(t—1). 
r=1 
It is interesting to note that the M{) depend on 7, and 7, only through the product 7,7). 
We see also that the probability of a final between C, and C, is 
Mp) = (27, 7,)?-1/(t— 1). 
If for the moment we imagine C, and C, to be ‘seeded’ players placed in opposite halves of an 
otherwise random draw, this probability would become 
(77772)? = 2M. 
We turn now to the general case where C; defeats C; with probability 7,;, the only restric- 
tion on the 7;; being 7;; = 1—7;,; (due to the absence of ties). It should be noted that the 


possibility 3 >, Me >4, Mh > 4 
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is not excluded (compare Kendall & Babington Smith, 1940). This situation can occur when 
the scale of playing strength is not linear, in which case we define the best player as the one 
with the largest expected score. The models of Thurstone and Bradley & Terry assume 
a linear scale corresponding to the choice of suitable expressions for the 7;;. As we are not 
concerned with estimation, they need no separate treatment here. 

To illustrate the general case take t = 8 and suppose (without loss of generality) that 
C,, ..., Cg have been drawn in that order. Then we have, for example, 


1 1 1 : 
PP = Ma, PP = May PY = Tyg, «+s shia 
2) _ pa )i7., Pa (72077 N47 " 
PY = PP (74, P$) + 14a PY?) = M2(7157 34 + 714743), (2-4) 

2 247,.P247,,P 747 ‘ 
PP = PP (msPP + MePP? + M7PP + mMgPP). (36) 


The corresponding probabilities before the draw can be obtained by averaging over all 
possible draws. Let P{’(i,j, k) denote the joint probability that C, beats C; in the first round 
and the winner of C;v.C, in the second round; then P{(2, 3,4) is the expression of (2-4). 
Likewise, we may (for ¢ = 8) write P{*) of (2-5) more fully as P{*(2, 3,4). It follows that 


ua 1 8 
{) = : UM» (2-6) 
i=2 
PO = Be DUD PM|4,j,b), ; 
ij <k (2-7) 
1+i+j+k 
PP = 5 DU VPP (i,j, b) 
¢ j <k 
1+i+j+k 
For ¢ > 8 the number of terms on the right-hand side may become formidable. Thus P{” is 
the mean of t—2\ (t-—4 ft — 2°-1 
(—1)( 2 Ng | gra ) terms. 


Example. In a tournament of 8 players, let C,’s ‘strength’ in his encounter with C; be 


represented by ig = Et V4, 


where £; is C;’s expected strength and the error variate v,; is N(0, 407), the 56;,;’s being 


mutually independent (compare Mosteller, 1951). 


The = 
‘ intiaai Sg Wai. 


-« (2m) 
We now take £; to be the expected value of the ith largest unit normal deviate in samples of 8, 
so that the players are arranged in decreasing order of strength with C, the strongest. The &; 
have been tabulated by Teichroew (1956). For o = 1 the following array of 7;;’s results: 


Tz = Pr(E;+ vi; < $+) = | 











| C, | C, | Cs | C, C; Cs C, Cs 
| | | 
en os 
OC, | —- | 07161 | 0-8291 | 0-8982 | 0-9425 0-9710 | 0-9886 0-9978 
| | 
| 02839 | —- | 0-6478 0-7579 | 0-8425 | 0-9074 | 0-9558 0-9886 
| 0-1709 | 0-3522 | — | 06256 | 0-7341 | 0-8278 | 0-9074 0-9710 
0-1018 0-2421 0-3744 | — | 0-6198 | 0-7341 | 0-8425 0-9425 
| 0-0575 0-1575 | 02659 0-3802 — | 06256 | 0-7579 0-8982 
| 0-0290 | 0-0926 0-1722 0-2659 | 03744 | 


| 
| 
00114 | 00442 | 0:0926 | 01575  0-2421 | 
00022 | 0-0114 | 0-0290 0-0575 0-1018 | 01709 
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It will be seen that due to the symmetry of the normal distribution 
’ 143 = M9-j>9-4- 

Applying (2-6) and (2-7) we obtain 

P® = 0-906, 0-769, 0-656, 0-551, 0-449, 0-344, 0-231, 0-094; 

P® = 0-781, 0-494, 0-319, 0-200, 0-117, 0-060, 0-024, 0-004. 
It is interesting to compare these probabilities before the draw with those in a draw in which 
considerable seeding has been used, the first round games being Cv. C,,C;v.C,, C,v.C,, 
C,v.C,. From (2-3) to (2-5) we find 

PP = 0-998, 0-956, 0-828, 0-620, 0-380, 0-172, 0-044, 0-002; 

PY = 0-913, 0-662, 0-312, 0-064, 0-023, 0-020, 0-006, 0-002; 

PY = 0-692, 0-216, 0-066, 0-019, 0-005, 0-001, 0-000, 0-000. 


3. Rounp ROBIN TOURNAMENTS 


The results of a Round Robin tournament can be presented fully in the familiar two-way 
table of 1’s and 0’s, with the scores (i.e. number of wins) of each player listed in a column of 
totals. As a summary of the scores, we may write (a, a, ... a,), meaning thereby that C, has 
won a, games, C, has won a, games, and so on; clearly La; = $t(t—1). If the a’s differ greatly, 
a real difference between at least some of the players is indicated. Thus a Round Robin 
tournament, unlike a Knock-out tournament—or a ranking—provides the possibility of 
a test of the null hypothesis, Hy, that all players are of equal strength even when there has 
been no replication. From this point of view the identity of the players is of no consequence, 
and we may replace (a,@,...a,) by the partition [aj:x}'...27"], where the z’s are simply 
a re-arrangement of the a’s in decreasing order of magnitude, and r, is the number of occur- 
rences of the largest score x,, etc.* It follows that 


™m™ 
> % = #, Uluhu = #(t-1). 


u=1 u= 

One test of H, is the ‘circular triad test’ due to Kendall & Babington Smith (1940); 
another has been given by Bradley & Terry (1952) and is based on their model referred to 
earlier. In both cases the test-criterion is a symmetric function of the scores, and its null 
distribution is easily deduced from a knowledge of the different permissible partitions of 
}t(t—1) together with their frequencies of occurrence. Such basic tables have been con- 
structed by Bradley & Terry (1952), and Bradley (1954) for t < 5. These authors also show 
how results for several complete repetitions may be built up from those for n = 1 and their 
tables cover many such cases. In Table 1 we have extended their results for n = 1 tot < 8, 
using a score of 1 for a win and 0 for a loss, rather than 1 for a win and 2 for a loss. 

A possible approach to the enumeration problem involved is to consider the generating 
function 


G(t) = i (6; +5;), (3-1) 


a product of }¢(¢—1) terms corresponding to the games played. The expansion of G(t) 
contains 2!“—) terms, the exponents in each of which correspond to a possible set of scores. 
For example, 

G(3) = (b, + bg) (6; +53) (bg +63) = 2b, 7b, + 26, bgbz, (3-2) 


* We depart slightly from standard notation in showing zeros explicitly. 
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Table 1. Partitions of scores and their frequencies in a Round Robin 
tournament of t players 
= 38 t = 6 (cont.) t = 7 (cont.) t = 8 (cont.) 
[210] 6 | [3323] 2,640 | [549212] 23,520 | [763421] 134,400 
1 2 5423720 60,480 | 763323 147,840 
| 3421 2,400 7533210 13,440 
Total 8 | 350 144 | 5423212 60,480 | 753318 4,480 
—— | 5493271 206,640 | 75°230 4,480 
Total 32,768 | 54224 28,560 
ay 54340 16,800 | 75%2212 13,440 
[3210] 24 543921 223,440 | 75242210 40,320 
313 8 t=7 7524213 13,440 
930) g | [6543210] 5,040 | 543223 183,120 | 75243710 80,640 
9212 94 | 654319 1,680 | 53°] 17,808 | 75243220 161,280 
__ | 654230 1,680 | 53422 72,240 
Total 64 | 6542212 5,040 | 4510 1,008 | 75243212 322,560 
653710 1,680 | 44320 16,800 | 7524231 188,160 
7523920 94,080 
% pest i Bic 44312 16,800 | 75391? 94,080 
’ 4422] 28,560 | 75%3?21 483,840 
Lenaiej sid 653231 11,760 | 43330 18,480 
4313 40 “ , 
4930 40 | 852 1,008 | 433221 183,120 | 752324 134,400 
64°210 1,680 | 43323 99,680 | 7549310 94,080 
42212 120 , , 
3310 40 7549220 94,080 
64°1° 560 | 4234] 72,240 | 7549212 188,160 
32920 199 | 04°3#10 5,040 | 423392 233,520 | 75423220 483,840 
6473270 10,080 | 4359 72.240 
32212 240 ranch 240 | 
393] og9 | 04°32! 20,160 | 37 2,640 | 75423212 483,840 
98 a4 | 04*2°1 11,760 — a | TSE 1,653,120 
Ring nom 760 | TO 2,097,152 | 754224 228,480 
, 754340 134,400 
ene 1,024 | 643918 11,760 7543921 ‘1,787,520 
6437221 60,480 _ 
t=6 ea ae [76543210] 40,320 | 754392 —- 1,464,960 
[543210] 720 ‘ 7654315 13,440 | 753°1 142,464 
54313 240 " 7654230 13,440 | 75342? 577,920 
54230 240 peta ig | 7654271? 40,320 | 74510 8,064 
54271? 720 | 533919 1.680 | 7653°10 13,440 | 744320 134,400 
53°10 240 | 53913 "560 
52930 560 | 76532270 40,320 | 744312 134,400 
537220 720 | 76532212 80,640 | 744221 228,480 
53°212 1,440 | ss02)2 1,680 | 7653291 94,080 | 7493%0 147,840 
2 ee ae oe 
49210 240 pond i 
5243710 10,080 
5243220 20,160 764518 4,480 | 747341 577,920 
4313 80 76423710 40,320 | 7423322 1,868,160 
423210 720 | 5243912 40,320 | 76473220 80,640 | 74352 577,920 
423220 1,440 | 52493) 23,520 | 764°3212 161,280 | 737 21,120 
423212 2,880 | 523390 11,760 | 7642251 94,080 | 6943210 13,440 
4°23] 1,680 | 523342 11,760 
52329212 60,480 | 7643°20 94,080 | 694315 4,480 
43320 1,680 7643912 94,080 | 6°42°0 4,480 
43912 1,680 | 52324 16,800 | 76437221 483,840 | 6942712 13,440 
43222] 8,640 | 549310 11,760 | 764324 134,400 | 693910 4,480 
4324 2,400 | 549220 11,760 | 76350 8,064 | 6932220 13,440 
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Table 1 (cont.) 














| t = 8 (cont.) t = 8 (cont.) t = 8 (cont.) t = 8 (cont.) 
[6937217] 26,880 | [6743729] 1,464,960 [654341] 3,790,080 | [543221] 7,889,280 
6°3231 31,360 | 67351 142,464 6543°22 12,230,400 | 5°432° 4,282,880 
6°25 2,688 | 673422 577,920 | 65352 1,876,224 | 5°341 1,025,920 
67573210 40,320 | 65°4210 94,080 | 533322 3,306,240 
6757315 13,440 64520 142,464 | 574420 577,920 
65°418 31,360 | 6451? 142,464 | 574412 577,920 
675230 13,440 | 65°3710 94,080 | 644370 577,920 | 5743370 1,868,160 
6757271? 40,320 | 65°3270 188,160 | 644321 3,790,080 
67542210 80,640 | 65°321? 376,320 | 64428 1,025,920 | 5749321 12,230,400 
6754718 26,880 | 65°23] 219,520 | 574328 3,306,240 
67543710 161,280 649331 3,924,480 | 574233] 9,461,760 
65747310 483,840 | 649322? 9,461,760 | 57423222 22,780,800 
67543270 322,560 | 65747270 483,840 | 647342 7,203,840 | 574342 11,518,080 
6754321? 645,120 | 65742212 967,680 | 643° 725,760 
6754231 376,320 | 65743720 1,653,120 | 55210 8,064 | 5736 577,920 
6753°20 188,160 | 6574371? 1,653,120 54530 577,920 
6753912 188,160 | 5518 2,688 | 54521 1,876,224 
65743271 5,644,800 | 544310 134,400 | 544371 7,203,840 
67537271 967,680 | 657424 779,520 | 544270 134,400 | 54432? 11,518,080 
675324 268,800 | 657340 228,480 | 54421? 268,800 
6745310 94,080 | 6573321 3,037,440 | 543220 228,480 | 54°32 23,157,120 
6749220 94,080 | 653728 2,486,400 | 54235 5,201,280 
6745212 188,160 | 543712 228,480 | 470 21,120 
| 654410 134,400 | 543271 779,520 | 4°31 725,760 
67473220 483,840 | 6549320 1,787,520 | 5424 107,520 | 4622 577,920 | 
67423712 483,840 | 654°31? 1,787,520 | 54°10 147,840 
674°3271 1,653,120 | 654°271 3,037,440 | 5°42320 1,464,960 | 45372 5,201,280 
674724 228,480 | 65473°0 1,464,960 | 4434 3,230,080 
674340 134,400 | 5842312 1,464,960 a 
65473721 14,515,200 | 5942271 2,486,400 | Total 268,435,456 
6743321 1,787,520 | 654732 7,889,280 | 5°43°0 797,440 

















the sum being over 6 terms. This identity may be interpreted as follows. In a tournament of 
3 players there are 6 outcomes of type [210] where one player wins both his games, a second 
wins one game and the third wins none; and 2 outcomes of type [1°] where each player wins 
onegame. G(t) is symmetric in the a’s and may be expanded as in (3-2) as a sum of monomial 
symmetric functions. Table 1 has been constructed essentially by noting that 
t 
G(t+ 1) = Gt) TD Ory +) = G()[Bh ga + (1) OFT + (1?) BT +--+ (14), 


i=1 
where (1°) = 2b, b,...5,, (8 = 1,2,...,é). 

Three generalizations of (3-1) are perhaps worth pointing out, although they do not 
necessarily provide an easy solution to the problems involved. 

(a) IfC,and C; play n,; games instead of merely one, the appropriate generating function is 


3? 


II (0; +5,;)"4. 
i<j 
(b) IfC, = C; for all i + j then G(¢t) can be replaced by 


to generate the probabilities of the various partitions. 
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(c) Suppose that instead of being two-point (1 and 0) the scoring scale is (r+ 1)-point 
{1,(r—1)/r, ..., (1/r), 0}, with the total score in any one game still unity. Then 
Ul (b; ¥ by Dirpyr rs bY— 2 Hair esate b;) 
i<j 
generates all possible outcomes. This includes the case where games may end in either a win, 
a loss or a tie (r = 2). 


3-1. Significance tests 


As already mentioned, several methods are available for testing the null hypothesis H, 
that all ¢ players in a Round Robin tournament are of equal strength. These tests are exact 
only for small values of t, but approximations for large ¢ have also been given. However, they 
are overall tests and do not provide an answer to the more detailed questions we may wish to 
ask. We consider the following questions: 

(i) What score must a specified player reach to be regarded as significantly better than 
average ? 

(ii) What constitutes a significant difference in scores between two specified players? 

(iii) On the basis only of the scores obtained, what constitutes a significantly high score? 

In order to deal with these problems the joint distribution of scores, on Hp, of s(< t) 
players is required. C,’s score clearly has the binomial distribution 

fay = (9) a 
To find the joint distribution of a; and a;, we note that these scores arise if C; defeats C; and 
wins a; — 1 of his other ¢— 2 games, while C; wins a;; and similarly if C; defeats C;. Thus 


torre sl) )Ca ke 


| 
The argument may be extended to give the joint distribution of s players C,,C;, ...,C,, by 
a consideration of the 22**—) outcomes of the }s(s — 1) games between these s players. If their 
scores in this sub-tournament are aj,q@j,...,@;, their final scores will be a;,a;,...,a, with 


probability 
f(a;,4 Ay,| @;,0;, ..., Az) = oy hie a 
i» Djs o+ + My ir Uy 0+, OK ~~ 9s(t—s) a a;— a; eee — 4 ’ 


provided we use the convention 


(") =0 forr<0 and r>n. (3-4) 
It follows that 
1 t—s 
f(Gj,.4;, «-+5 My.) = ghee”, Hl La = 


where the sum is, in effect, over all outcomes of the sub-tournament compatible with the 
final scores. 


We turn now to questions (i)-(iii) above. 


(i) Test of the score of a specified player 

Let C, be the player in whose performance we are interested. Since, on Hp, a, is a binomial 
variate with parameters t — 1, 4, it is easy to test H, against the alternative that C, is above 
average strength (one-sided binomial test) or different from the average strength of the 
other players (two-sided binomial test). For example, at the 5% level of significance the 


10 Biom. 46 
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following are the smallest values of a, which are significantly higher than the expected value 


$(t—1): t a; 
<5  nosignificantly high score possible 
6-8 t—1 
9-ll ¢t-2 


>11 smallest integer > }[¢+ 1-645,/(t—1)]. 


The large-sample result follows from the normal approximation to the binomial, with 
continuity correction. 

Next, suppose that the players are not of equal strength, but that it is desired to test 
whether C,’s average probability of success 7,, equals 4. We have 


€(a,) = (t—1)m,, 
t 
var a, = Sm —;) < Z(t—1). 
jJ= 


Since the variance of a, is a maximum under H), we may conclude that the above test will be 
conservative if H, is not true. In fact, as 

vara, < (t—1)m,(1—7,) 
we can also test the hypothesis that 7, has a specified value 7, by referring a, to the 
binomial distribution with parameters ¢t— 1, 719. 


(ii) Test of the equality of scores of two specified players . 
We shall find the probability distribution p(d) of d = a,—a,, assuming H, to hold. 
From (3-3) 


Pld) = Eflay+d, 4) = 3 [2(_ ca :) ('=2) he pot. 


where in view of the convention (3-4), the summations may be taken over all non-negative 
integers a,. Thus 


wd) = sa3|(p-g--1) + (pga) d= —(-1), -—@-3).... @—J), 


is a symmetrical distribution whose variance is }t. It can be shown that the characteristic 
function of d is (u) = (cos }u)*-* cos u, 
and hence that d/,/($t) tends to a unit normal distribution. Numerical work indicates this 
tendency to be rapid. 

At the 5% level of significance, the smallest significant values of |d| are as follows: 


t [a| 
<4  nosignificant values of |d| possible 
5-6 4 
7-10 5 


>10 smallest integer > 1-96 ./(4t)+ 0-5. 
While this approach tests equality of the two scores under H, it will also provide a con- 
servative test of the null hypothesis 
Ho: ,=7,, against the alternative 7, + 7,,; 
for, in the general case, we find 
t 
vard = 4749(1 —79) + Blms(l — yj) + Maj(1 — 719;)], 


which is a maximum under J). 
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(iii) Test of the top score 

The test developed in this section is essentially different from those in (i) and (ii) in that it 
is not based on the scores of specified players, but on the score x, of the winning player (or 
players). We obtain, on Hj, the probability of large values of x, from which upper percentage 
points may be constructed. If in a particular tournament the appropriate upper percentage 
point is attained or exceeded by one or more players, H, is rejected and, as in the analogous 
problem of testing for ‘outliers’, these players may be regarded as ‘superior’. 

It is easy to see that for t < 8 the probability distribution of x, could be built up from 
Table 1. We shall employ a different approach which is useful also for larger values of t. 
Since 2, is the largest of the scores @,, @, ..., a,, the method of inclusion and exclusion gives 
(see, for example, David, 1956) 


i 
Pr(z, > t—r) = }(-)*" (‘) Pr(a, > t—r,a, >t—r,...,a, >t—r), (3-6) 
s=1 / 


where r is any integer from 1 to ¢. For small values of r, the later terms in the sum will be 
zero, since only a few players can have a large score. We illustrate the method on the evalua- 
tion of the typical term 

Pr (a, > t—3,a, > t—3,a, > t—3,a, > t—3). 


Consider the sub-tournament played by C,, C,, C, and C,. From Table 1 we see that the 


possible outcomes are 
[3210], [313], [230], [2212] 
with respective frequencies 
24, 8, 8, 24. 


It is, however, clear that only [31%] and [2?1?] can result in final scores all greater than ¢ — 4. 
The possible outcomes (ignoring the order of C, to C,), and the frequencies with which they 
can arise from [31%] and [2717], are as follows: 


[31°] [2°17] 
tt. Se 4-8 Fee 1 0 
ie oe ae 0 1 
ie tS 60k 4-5 t—4 2(t — 4) 


is 1-5-3 &-3 -GE-H. O-e 


This gives a total frequency of 28¢? — 172t+272, which can be converted into the required 
probability on division by 27-5, the factor of equation (3-5). In this way we obtain from 
(3-6) 

t 


Pr (z, = t—1) = 9-1’ 
t’ t 
t? (;) ape (;) 
Pr (x, > t— 2) = 9-1 ~ 92-4 + 537-7" 
(;) 
t 2 
Pr (x, > t—3) = 5 (?—#+2)— 35 (4° + Tt—4) 


(5) (1) 
‘_ 4 
+ 531-6 (5t — 33f + 78¢ — 64) — 9u-18 


(5) 


Q5t—18 * 





(74? — 43t + 68) + 
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These three probabilities are as follows for ¢ < 20: 























t | Pr (x, > t—1) Pr (x, > t-—2) Pr (x, > t-—3) 
3 | 0:7500 1-0000 1-0000 
4 | 0-5000 1-0000 1-0000 
5 0-3125 0-9766 1-0000 
6 | 0-1875 0-8418 1-0000 
7 | 0-1094 06447 0:9987 
8 0-0625 0-4526 0-9637 
9 | 0-0352 0-2989 0:8536 
10 | 0-0195 0-1891 0-6868 
11 | 0-0107 0-1161 0-5093 
12 0-0059 0-0696 0°3548 
13 | 0-0032 0-0410 0-2360 
14 | 0:0017 0-0238 0-1517 
15 0-0009 0-0137 0-0950 
16 0-0005 0-0078 0-0584 
17 0-0003 | 0-0044 0-0353 
18 0-0001 0-0025 0-0211 
19 | 0-0001 | 0-0014 0-0125 
20 0-0000 0-0008 0-0073 





We see from this table that an unbroken sequence of wins is not significant, at the 5 % level, 
until ¢ = 9 in the case of a one-sided test and ¢t = 10 for a two-sided test. For a one-sided test 
a score of ¢— 2 is significantly high for ¢ > 13, and a score of t—3 for ¢ > 17. 


4. Discussion 


Some properties of Knock-out and Round Robin tournaments have been presented. We 
now make a few remarks about their respective merits and drawbacks. 

The attraction of Knock-cut tournaments is, at least in part, that a large number of 
players can be handled quickly. With ¢ = 2? competitors a decision is reached after p rounds 
and t—1 games as against t— 1 rounds and 3¢(t—1) games required for a Round Robin 
tournament if no play-offs are necessary. A natural objection to Knock-out tournaments is 
that they are too unreliable. This is often true in the simple cases discussed in § 2, but in view 
of the relative brevity of such tournaments it may well be practicable to repeat them. The 
simplest way of doing this is to start with a fresh random draw for each repetition and to 
declare as winner the player with the largest total number of wins, possibly after a play-off. 
Alternatively, the initial draws of each repetition could be arranged to satisfy certain 
symmetry requirements. We do not recommend either of these approaches if the aim of the 
tournament is to rank all players in order of merit. For this purpose a simple Round Robin 
tournament will be preferable to }¢ repetitions of a Knock-out tournament, although both 
require the same (minimum) number of games. However, the situation will be very different 
when we are primarily concerned with picking the best player, since the repeated Knock-out 
tournament will tend to include a larger number of encounters between the stronger players. 
Some work along these lines is in progress. There are also possibilities, for both types of 
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tournaments, of some sequential procedure whereby the number of contestants is progres- 
sively reduced. 

In this paper attention has been concentrated on tournaments without repetition of any 
kind. When comparing a number of treatments in a paired comparison experiment, we will 
often require some repetition, possibly by different judges. If repeated Round Robin 
tournaments are impracticably large, the incomplete block type designs put forward by 
Kendall (1955) and Bose (1956) are helpful. However, to answer the type of question con- 
sidered in § 3, generalizations of tests there given as well as new tests are required. It is hoped 
to deal with some of these issues in a future publication. 


I should like to thank Dr R. A. Bradley for some helpful discussions and Dr I. R. Savage 
for a valuable comment. My thanks are also due to Miss Betty Laby and Miss G. E. Jacobs 
of the University of Melbourne and to Mr A. Romano of the Virginia Polytechnic Institute 
for assistance with the computations. 
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ESTIMATION OF THE NORMAL POPULATION PARAMETERS 
GIVEN A SINGLY CENSORED SAMPLE 


By J. G. SAW 
University College London 


1. INTRODUCTION 


The problem of estimating the parameters of a normal population given an ordered sample 
X, < X,... < x, censored above x, has been treated by several authors. 

Gupta (1952) has investigated the maximum likelihood solutions and the most efficient 
linear unbiassed estimators for ~ and a, the location and scale parameters. The simultaneous 
equations of the maximum likelihood solution are not immediately soluble. In his paper 
Gupta provides a table which, if enlarged to give finer argument intervals, would make the 
solution comparatively rapid. No information, however, seems to be available as to the 
extent to which the resulting estimates of wand o are biased; this is likely to be of importance 
in small samples. The estimators proposed below, while based on the same statistics as those 
involved in the maximum likelihood equations, namely z,, and the first and second moments 
of the observations about x,, combine them in such a way that the estimates of ~ and o? are 
unbiassed, however small the sample. 

The method of most efficient linear unbiased estimators, whilst more easily handled 
computationally, suffers from two defects. In order to obtain the system of weights, it is 
necessary to invert a matrix of order equal to the number (r) of observations available. These 
weights differ for every set of values taken by r and n, thus requiring extensive tabling and 
arduous preliminary computations. Further, and this is a more serious difficulty, the weights 
are functions of &(y;), f(y?) and &(y,y;), where y, < yz... < y, is an ordered sample from the 
standard normal population. At present these are only tabled for sample sizes n < 20, 
(Sarhan & Greenberg, 1956). 

Gupta has overcome the labour of the matrix inversion by proposing a modified linear 
estimator, the weights being simple functions of &(y;) only. These modified estimators are 
reasonably efficient but we are again limited in the use of them by the fact that, as yet, the 
values of &(y;) are not tabulated with sufficient accuracy for n > 20. 


2. ESTIMATORS SYMMETRICAL IN 2}, Xp, ..., Xp_4 


k r—1 
If we take “* = €%,_,+(l-—e)z,, with Z%,_, = D2,/(r—1), 
i=1 


r—1I r—1 2 

yt = aS (a —a,)*+ |S (ea) 

as estimators of u and o?, respectively, the ¢ being chosen to make ~* unbiased and a and / 
being chosen to make 7* unbiassed and of minimum variance, then providing these esti- 
mators are reasonably efficient, they will have immediate advantage owing to the small 
number of weights which have to be established. In fact it is found that the large sample 
efficiency of ~* varies between 0-948 when r/(n + 1) = 0-20 and 0-993 when r/(n + 1) = 0°80. 
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Further, «* has a smaller variance than the corresponding modified estimator due to Gupta. 
The asymptotic efficiency of 7* is unity for all values of r/(n + 1). 
Apart from the fact that they occur in the maximum likelihood equations, the reason for 


f—1 2 
considering such statistics as Z,_,, 5 (x;—2,)? and XY (x;- x)| is that the values 2, ...,%,_1 
1 1 


enter symmetrically. Thus we may regard «,, ..., #,_, as an ordered sample from the popula- 
tion conditional on x,, with density function 


rele) aamel-UEAIY IL dee (eee 


However, for the purposes of this work, since ~* and 7* are symmetrical in 2,,...,2,_,, we 
need no longer regard them as ordered. In effect therefore we no longer need the individual 
values of &(y;), &(y?) and &(y;y;) mentioned in the introduction. 

In a previous paper by the author (1958) it was shown how it was possible to obtain 
moments and product moments of %,_, and 2, in terms of a linear sum of integrals of the type 





ee) Z a 
VPnm: 4,0) = Bey | Zw) UF) Few) Kat ub du, 


where Z(u) = — e*) F(u) -[" Z(t)dt and p,=r/(n+1), 
and also how it was possible to expand these integrals as a power series in 1/(n + 2); tables 
were given fora+b < 4, p, = 0-50(0-05) 0-80. We may treat moments and product moments 
of X(x;—2,)? and [X(z;—~,)]? in a similar manner. Ultimately, therefore, ¢, « and # may be 
expressed as power series in 1/(n + 2) though they are given at the end of the paper as power 
series in 1/(n+1), since this form is thought to converge more rapidly. In addition, it is 
possible using Sarhan & Greenberg’s tables to give exact values for e and var (*) for 
l<r<ng< 20. 


Writing 3. ESTIMATION OF 4 


Hig = E[ (2,1 — ) | o), for = E[(%,— zh) | oc}, hi = ot) E[(%,_1 —F(%,_1))* (x,—&(z,))"] 
we see that if ~* = eZ,_, +(1—€) 2, is to be an unbiassed estimator for », then we must have 


' € = flyy/(Mo1 — Hi0)- 
With this value of ¢€ 
var (*) = 07( WG? foo — 2po1 40/11 + 18/02)! (M01 — 10)” 


Exact values of e(r,n) and var (u*) are given in Table 1 for sample sizes n < 20. 
For use with sample sizes greater than twenty, the expansion 


e(r,n) = SEU) (n+1)#+O(n+1)* with p,=7/(n+1) 


was obtained and will be found to give an excellent approximation to the true values at 
n = 19 (correct to the eighth place of decimals in most cases). The weight ¢ is a function of 
both r and n; the complete form e(r, n) has been used above in view of a relationship between 
e(r,n) and e(n—r+1,n) which is given below. 
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Similarly, we obtain an expansion for the variance of ~* of the form 


* 
var (<) 

o 
The quantities Z;(p,) and V,(p,), which are functions of the ratio p, = r/(n + 1) andi only, are 


given in Table 2 for p, = 0-50 (0-05) 0-80. Values to cover the interval 0-20 < p, < 0-50 may 
be obtained using the relations 


; V(p,) (n+ 1)-*+ O(n + 1)-. 
i=] 





(r,n) 





i i var (u*/o) ln-o42,.0)— (1/n) 
(r, n) m n {1 —ne(n+ 1 —r,n)/(n—r)} : 











* 
var (“) 
oe 


4, COMPARISON OF /4* WITH OTHER ESTIMATORS 





Gupta has tabled the large sample variance of f, the maximum likelihood estimator of y. 
Comparing these tables with the leading term V,(p,)(n+1)—, we obtain the asymptotic 
efficiency of * for various values of p,: 











Asymptotic Asymptotic 

Pr efficiency Pr efficiency 
0-20 0-9485 0-55 0-9711 
0-25 0-9479 0-60 0-9764 
0-30 0-9491 0-65 0-9813 
0-35 0-9519 0-70 0-9857 
0-40 0-9559 0-75 0-9896 
0-45 0-9606 0-80 0-9929 
0-50 0-9658 




















We may also compare the efficiency of ~* and “7, (Gupta’s modified estimator), relative 
to ,, the most efficient linear unbiased estimator. 
Thus for a sample of size ten we have 
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It should also be noticed that ¢ = 0 whenever p, = r/(n +1) = }. Thus if we are given the 
observations up to and including the median, we disregard all but the median value in 
forming an estimate of w. Although this will at first sight seem a great waste of data, it will 
be observed from the first table in this section that the asymptotic efficiency of the median 
in this context is 96-58 %, whilst the ratio (variance ,)/(variance u*) takes the values: 


0-9899 when n=5,r=3; 09843 when n=7,r=4; 
and 0-9806 when n=9,r= 5. 


Thus when only }(n + 1) of the observations are available, very little is lost by neglecting all 
but the median observation as far as the estimate of ~ is concerned. In contrast, the asymp- 
totic efficiency of the median relative to the complete sample of n is 63-66 %. 


5. EstTImMatTIoN oF o? 


r-1 ifr-1 ad | <a 
Defining Hy = é|| = (,—2,)| | x (,-2)| arn, 
t=1 l=1 
r—1 r—1 2 
we see that n* = a> (u;,—2,)? + Al Dd (a; -x)| 
i=1 i=1 


is unbiassed for a? and of minimum variance over all possible (a, £) if 
a = (Hig Hop — Ho, H43)/(A i$ Hoo + Hoi x9 — 29 Ho A311), 
B = (Ao Ao — Ayo Hi1)/ (A156 Hoe + Hot 29 — 29 Ho, Hi), 
and that with these values of a and # 
Hy Hoe — Axi 


eiea\ ee 
we IO) ~ Was dl et 


Proceeding as indicated in § 2, we find expansions of the form 


R 
ll 
M* 


A,(p,) (n+ 1)-*+ O(n + 1), 


on 
| 
= 


xX 
I 
IMe | 


tb 


B,(p,) (n+ 1)-*+ O(n +1), 


v 


Me 


var (9*/o?) = > W,(p,) (n+ 1)-*+ O(n + 1). 


1 


Values of A,(p,), B;(p,) and W,(p,) are given in Table 3. 

By comparing W,(p,) (n + 1) with the large sample form of the variance of 6?, the maxi- 
mum likelihood estimator of o?, it is found that 7* has asymptotic efficiency of 100 % for all 
values of the ratio r/(n +1). 

It has not been found possible to give simple relations connecting «(r,n), &(r,n), var 9* |¢ ») 
and a(n—r+1,n), B(n—r+1,n), var 7* |(,_,.1,,) Without bringing in auxiliary tables. How- 
ever, it is hoped that the existing range on p, will meet most requirements. In any case, an 
estimate of variance will be most unreliable when more than half the observations have been 
censored. 
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6. INTERPOLATION IN TABLES 2 AND 3 


Owing to the labour involved in producing the tables, it was not found possible vo give a fine 
entry for p,. However, the following method of interpolation gives satisfactory results. 
Suppose that n and r are given and that p, = r/(n + 1) is nota tabulated value. Let (0-65) 


5 
denote, for example, } £,(0-65) (n+ 1)-*; then if h = 20r/(n+1)—13, we may use as an 
i=1 


approximation to U(p,) the expression 














h(h®— 1) (h?—4) (4-9) [U(0-50) 6U(0-55) , 15U(0-60) _20U(0-65) 
720 h+3 h+2 bl h+1 h 
15U(0-70) _6U(0-75) | U (0-80) 
a ~ mae Bia om SS 


This corresponds to Lagrange 7-point interpolation and is reasonably quick to apply. 
As an example, using this method with r = 7, n = 10, we obtain 


€ = 0-3869 5262, whereas the true value from Table 1 is 0-3869 5268; 

var (u*/o0) = 0-11796547, whereas the true value from Table 1 is 0-1179 6680; 
a = 0-1938 

— f = 0-01767 
var (y*/o7) = 0-3815 


No check is available on these values but they are thought to be 
correct to the number of places of decimals given. 


The formula was also used for extrapolation and applied to the power series for ¢ in the 
cases n = 19;r = 17, 18 and 19. Checking against the true values in Table 1, the errors were 
found to be 1.10-5, 3.10-5 and 2.10~-4, respectively. 


7. A WORKED EXAMPLE 


The following example is taken from Gupta’s paper. 
The table gives the day on which the first seven of ten tested mice died after being 
inoculated with a uniform culture of human tuberculosis. 


Day 41 44 46 54 55 58 60 

Log day = (z,) 1613 1-644 1-663 1-732 1-740 ' 1-763 1-778 

Fiequency 1 1 1 1 1 1 ] 
It is found that 


6 6 2 
Z, = 16925, wz, =1-778, > (%;,—27)? = 0-062191, | (2—a)| = 0-263169. 
i=1 i=1 
Thus p* = (0°3870) (1-6925) + (0-6130) (1-778) = 1-745, 
n* = (0°1938) (0062191) — (0-01767) (0-263169) = 0-00740. 
An estimate of the variance of * is (0-1180)7* = 0-873 x 10-3. 
An estimate of the variance of 7* is (0-3815) y** = 0-209 x 10-4. 


In passing, it is perhaps worth mentioning that ~* has been found to be distributed very 
close to normality. Thus for rough tests on the hypothesis ~ = 9, it may be possible to refer 
(“* —Wo)/,/(est. var u*) to the standard normal distribution. It seems intuitively more 
likely, however, that the distribution of this ratio will be better represented by the Pearson 
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Type IV curve. Similarly, for a rough test of the hypothesis 7 = o>», we could refer 4* to the 
Pearson Type III distribution with the appropriate mean and standard deviation. These 
two problems have yet to be fully investigated and will probably form the subject of a later 
paper. 


I wish to express my gratitude to Prof. E. 8S. Pearson, whose suggestions are responsible for 
several improvements on the original paper. 
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Table 1. Values of the weight ¢ and the variance of u*/o forl<r<n< 20 





| 























| Weight, e var u*/o 
as See SS 
= 3r= 2 Zero 04486 7110 
= 4,r= 2)| —0-40555159 | 0-5129 9280 
3 -3093 2088 | -28824812 
= 5,r= 2) —0-74110682 | 0-6111 2918 
3 Zero | +2868 3366 
4 47249056 | +2185 7232 
= 6,r= 2/| —1-02606712 | 0-7186 4005 
3 | —0-2676 7985 | -3041 5115 
4 22269148 | -20895708 
5 57350999 | -17744443 
| 
a | 
= 7,r= 2) —1-27331715 | 0-8263 6223 
3 | —0-5023 8193 3302 2028 
4 | Zero | +2104 4686 
5 | -3642 6439 | -1674.8290 
| 
| 
6 | 0-64223186 | 0-1498 1238 
eee Ba 
| | 
= 8 r= 2) —1-49153218 | 0-9309 9884 
3 | —0-7109 1496 | -3604 2823 
4 | — -19970421 | -21807919 
5 ‘1737 4521 | -1646 3021 
6 | 0:46239456 0:°1409 3561 
7 69200548 | -1298 1932 
ae bees: Wet 
= 9r= 2| —1-68675767 | 1-03129527 
3 | —0-8983 5837 | 0-3924 5050 
4 | — -38028184 | -22925388 
5 Zero | -1661 0128 
6 02960 5268 | 0-1368 8836 
7 -5344 6005 | +1221 7529 
8 ‘7297 0989 | +1146 2569 
one | 
=10,r= 2 | — 1-8633 5148 | 1-1269 0294 
3 | —1-06850751 | 0-42504749 
4 | — 05448 8270 | +2425 0203 
5 ia 1592 4349 | -1703 1365 
6 | 01423 7402 | 0-1359 7144 
7 | -3869 5268 | -1179 6680 
8 | -5896 3408 | -1080 8017 
9 | 7592 5335 1026 6399 

















Weight € var p*/o 
n=ll,r b- — 2:0245 4630 1-2178 6597 
3 — 1-2238 3557 0-4573 7320 
4 — 0-6960 0994 -2569 4929 
5 — -3060 1488 -1763 0723 
6 Zero 0-1371 6243 
7 0-2492 5991 -1160 7211 
8 *4572 0905 -1040 6917 
9 *6332 2913 -0970 3950 
1¢ *7830 2152 | -0929 9029 
a=12,¢ 2 — 2-1728 1803 1-3044 1143 
3 — 1-3678 0736 0-4859 3821 
4 — 08356 5351 2720 5514 
5 — -4420 2130 -1834 7202 
6 — 0-1324 0995 0-1398 0858 
7 *1205 7511 *1158 5477 
8 +3325 5203 -1018 4129 
9 -5131 4930 | -0933 4070 
10 -6685 3886 | -0881 2541 
ll 0-8324 6899 0-0847 2881 
n=13,r 2 — 2-3100 7581 1-3868 1251 
3 — 1-5009 4676 0-5208 4280 
4 — 0:9654 0881 -2874 7620 
5 — +5686 7675 -1914 0681 
6 — 0-2560 4852 | 0-1434 7564 
ss Zero *1167 9900 
8 +2152 0220 -1009 0906 
9 +3993 2369 °0910 3555 
10 -5587 4621 -0847 5964 
ll 0-6977 1536 0-0807 6006 
12 *8188 8582 *0782 8340 
n= 14,r 3 — 2-4378 4620 1-4653 7120 
3 — 1:6250 7121 0-5513 4148 
4 — 1-0865 6888 +3029 9021 
5 — 0°6871 5159 *1998 4054 
6 — 0-3719 4277 0-1478 6561 
7 — +1133 1319 -1186 0682 
8 -1045 5472 -1009 3894 
9 -2915 1408 -0897 6990 
10 -4540 6085 -0825 0407 
ll 0-5966 2366 | 0-0777 1198 
12 +7222 2478 -0745 6212 
*8327 4358 -0725 5809 
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Table 1 (cont.) 
| Weight, ¢ | var p*/o Weight, ¢ | var plo 
a —|— Re eee, : EL eI 
n=15,r= 2| —2-5573 5741 | 1.5403 7895 | n = 18,r = 6 | —0-77376245 | 0-1692 4581 
3 | —1-5910 5633 | 0-5162 8847 7 | — -50776661 | -1308 0404 
4 | —1-2001 9350 | -3184 5172 8 | — -28250321 | -1064 6866 
5 | —0-7984 1909 | -2085 8619 9 | — -08794308 | -09103752 
| 10 -0825 9311 | -0802 8344 
6 | — 0-4809 6831 | 0-1527 6888 | 
7 | — -22012308 | -12105385 11 0-2337 6240 | 0-0727 5085 
8 | Zero | +1016 9465 12 -3689 2384 | -0673 7399 
9 | -1893 1561 -0892 9543 13 -4905 5815 | -0634 8909 
10 | ‘35439077 | -0810 9450 14 | -6005 1947 | -0606 6704 
15 ‘7001 8374 | -0586 2267 
11 0-4997 5262 | 0-0755 6299 | 
12 6285 8591 | -0718 0372 16 0-7905 1758 | 0-0571 6368 
13 -7431 0067 | -0692 6842 17 | ‘87204112 | -0561 6310 
14 -84464790 | -0676 1792 & 
| 
ies eer | 
| n=19,r= 2| —2-9705 2895 | 1-8100 4988 
n= 16,r= 2| —2-66961409 | 1-6121 0956 3 | —2-14419951 | 0-6910 0073 
3 | —1-8506 3947 | 0-6097 5853 4 | —1-59491464 | -3780 2346 
4 | —1-30716059 | -3337 6521 5 | —1-1859 4337 | 2445 7027 
5 | —0-90329419 -2175 1772 | 
6 | —0-8617 6868 | 0-1750 4878 
6 | —0-5838 7075  0-1580 3503 7| — -59440913 | -1345 4868 
7 32109497 +1239. 7744 8 | — -36780590 | -1091 3104 
8 | — -09902945 | -1030 4166 9 | — -17190350 | -0923 2730 
9 -0922 8706 | -0894 3219 10 | Zero | +0807 9098 
10 -25947023 | -0803 4191 | | 
| 11 | 01525 8385 | 0-0726 4730 
ll 0-4071 0746 | 0-0741 1147 12 | +2892 3182 | -0667 8006 
12 -5384 7038 | -0697 8395 13 | 41245536 | -0624.9205 | 
13 6559 1509 | -0667 6886 14 | -5241 5083 | -0593 3084 
14 7610 9259 | -0646 9077 15 | -6257 5867 | -0569 9385 | 
15 ‘8549 8345 | -0633 1093 | | 
16 | 071835714 | 0-0552 7424 | 
en te | 17 | 8026 9911 | -0540 2045 | 
n=17,r= 2]| —2-77544828 | 1-6808 1522 18 | *8791 5996 | -0531 6423 | 
3 | —1-95380346  0-6376 7089 ie As: Bhd | 
4 | —1-40820482 | -3488 6837 | 
5 | —1-00246439 | -22652675 | n = 20,r = 2 | —3-06086752 | 1-8709 7592 | 
| 3 | —2-23246540 | 0-7164 7801 | 
6 | —0-6812 8676 | 0-1635 5464 4 | —1-68156241 | -3925 8856 | 
7 | — -41680820 | -12725750 5 | —1-27118372 | -2535 1721 
8 | — 19304540 | -1047 4082 | 
9 Zero | +0900 4658 6 | —0-9457 1364 | 0-1809 1765 
10 -1689 7949 | -0801 0670 7 | — -67711925 | -13843893 
| 8 | — -44930972 | -1116 5405 
ll 0-3185 2094 | 0-0732 1078 9  — -25220650 | -0938 5532 
12 45194855 | -0683 4595 10 | — -07908873 | -0815 6600 
13 5716 9627 | -0648 8380 | 
14 6795 4769 | -0624 2044 11 0-0747 4052 | 0-0728 3429 
15 *7767 5745 | -0606 9067 12 | +2126 8352 | -0664 9576 
13 | -3372 7331 | -0618 2136 
16 | 0-86404026 | 0-0595 2219 14 | -4504 3378 | -0583 3664 | 
| | 15 |  -55364389 | -0557 2300 | 
| | 
n=18,r= 2| —2-8755 5681 | 1-7467 2583 16 | 0-64804129 | 0-0537 6121 
3 | —2-05147109 | 0-6647 4230 17 7344 8217 | -05229780 
4 | —1-5039 4667 3637 2129 18 8135 5787 | -0512 2505 
5 | — 1-0965 1402 | +2355 6194 19 | +8860 9203 | -0504 6728 
| 











and (b) the variance, of the estimator of location, u* 


5 
(a) € = DE p,) (n+1)-*+O(nt+1)* with p, = r/(n+1) 
i=0 


Estimation of the normal population parameters 


Table 2. Coefficients of (n+1)~‘ in the series approximation to (a) the weight factor € 
























































0-80 | 1-0698 709 








| | wi | 
p, | Eelp,) Ep) | Balp,) | Bal) | Exp) | Eglp,) 
. eer 1a 
0-50 | Zero | Zero } Zero | Zero Zero Zero 
0-55 | 014865772 | 0-0783132 | 0:006281 | —0-04107 — 00-0201 0-077 
0-60 -2823 5913 | °1375 787 001435 | — -07785 — -0248 -161 
| | 
0-65 0-40340719 | 0-1818639 — 0-0123 37 | —0:°11338 | —0-0159 0-273 
0-70 -51356217 -2138610  — -034313 — -15044 -0100 *448 
0-75 | -61418208 | -2352568 | — -065129 — -19253 | -0646 -763 
0-80 | -7063 1072 +2468 760 — -:107286 — +24566 -1784 1-435 
y* 5 
(6) var (<) = DVi(p,) (n+ 1)-§+ O(n+1)-* 
i=1 
Pr Vi(Pr) | V,(Pr) Vi(p,) | Valpr) =| Var) 
7 eee 9 | = nae 
0-50 1-5707 963 0-896605 | 0-09873 | —0-4265 — 0-132 
0-55 1-4169573 | -716520 -07237 — +1662 *275 
0-60 1-3034728 -633049 ‘17656 | +2218 -970 
| | 
0-65 1-2186 755 | 0-6052 97 0-32705 | 0-5913 1-481 
0-70 | 1-1547730 | -6100 85 | *48554 -9072 1-840 
0-75 | 1:1064195 -6340 26 | -63859 | 1-1676 2-090 
| -669408 -78204 | 1-4575 2-333 
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J. G. Saw 
Table 3. Coefficients of (n+1)-* in the series approximation to the weights a and B 
used in estimating o7 and for the variance of this estimator 
Pr A,(p,) Ap) | — As(Py) A,(P,) 
| 
€ 
0-50 2-4829 06 5-61883 6-8137 16-886 
0-55 2-213248 4-34260 43813 10-188 
0-60 1-989519 3-40329 | 2-7795 6-215 
= 0-65 1-8008 52 2-69428 | 1-7316 3-852 
0-70 1-639499 | 2-14687 0-9989 2-226 
) 0-75 1-499774 | 1-71526 | 0-4764 1-276 
0-80 1-3773 85 | 1-36769 | 0-0451 | 0-515 
Pr B,(p,) Bip) | Bap) Bs(p,) 
| oy we Se 
0-50 | — 1-517094 —9-70572 | —11-8257 | — 32-504 
0-55 | —1-603473 —7-85637 | — 8-9535 — 21-737 
| 0-60 | —1-604646 | —6-42606 | — 67706 | —14-903 
<i | | 
0-65 | —1-560119 —5:30056 | — 51900 | —10-557 
0-70 | —1-491833 —4-40321 | — 3:9500 | — 7:335 
| 0-75 | —1-412189 —3-67797 | — 2-9867 — 5-184 
| 0-80 —1-328224 | —3-08317 — 2-1429 | — 3-438 
| | | | | | 
| Pr | W, (pr) Welp,) | Walp) W,(p,) 
| re Pipes «aT Ree MEER sey 
0-50 | 4:9658 12 9-05846 | 16-1363 32-610 
0-55 | 4-4264 96 7-11698 | 11-2447 20-516 
0-60 |  3-979038 566638 |  7-9504 13-174 
| 0-65 | 3601703 455496 | 5-6512 8-494 
0-70 | 3-2789 98 3-68410 | 4-0015 5-446 
0-75 | 2-9995 48 3-00114 2-8366 3-585 
: 0-80 | 2-7547 69 2-41742 18451 | 1-902 
' | 
| 4 5 
| a = DAP) (n+ 1+ Ont), B= YBUp,) (nt )-#4O(n+ 1), 
i=1 i=2 





4 
var (n*/o*) = Y)Wi(p,) (n+1)-*+O(n+1), with p, = r/in+1). 
i=1 
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ON HOTELLING’S GENERALIZATION OF T? 


By K. C. SREEDHARAN PILLAI} anp PABLO SAMSON, Jrt 
The Statistical Center, University of the Philippines 


1. INTRODUCTION 


Let S, and S, denote the matrices consisting of the sum of squares and products of deviations 
from means for two independent samples of sizes n, and n, respectively, taken from 
p-variate normal populations. Then 7? (Hotelling, 1951) may be defined by 


T?|(n,—1) = trace (Sz18)). 


It is a generalization of his T? statistic. Since the trace of a matrix equals the sum of its 
characteristic roots, 7'/(n,—1) is the sum of the characteristic roots of the matrix Sy18,. 
Define U® as the sum of the characteristic roots of Sy18,, where s is the number of non-zero 
roots. Thus s = pif ,,n, > p. It may be noted that 0 < U® < a. 

We give here expressions for the moments of U® for s = 2,3, ...,6. Upper 5 and 1 % points 
of the distribution of U® have been computed for s = 2,3 and 4 for various values of two 
supplementary parameters using the exact moment quotients of U. Comparisons of these 
values for s = 2 are made with those obtained from the exact distribution, and those from an 
approximation by Pillai (1954). For s = 3 and 4, comparisons are made only with the 
approximation. A numerical example is also given to illustrate the use of the criterion U®. 


2. THE MOMENTS oF U) 


By making use of a recurrence relation given by Pillai (1954, 1956) the first four central 
moments of U® for s = 2,3, 4,5 and 6 have been obtained. We shall write 


m =4(n,—s—2), n= }(n,—s—2). (2-1) 


The nature of the first three moments suggests the following general forms: 








pe = s{m eet (2-2) 
)  m+4h(s+1)} {n+m + 4s + 1)} (2n+8) ei 
Ce —_ aes | o 

(e) _ 28{m+4(8 + 1)} {n+ m+ }(s + 1)} (n+ 2m +s + 1) (2n + 2s) (2n +8) 
pO = + ome Ears ———-, (2-4) 


n3(n — 1) (n— 2) (2n + 2) (2n+1) 


Although the fourth raw moment of U has also been generalized (Pillai & Mijares, 1959), 
the central moment has not yet been obtained because of the heavy algebraic computations 
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involved. The fourth central moments of U® for s = 2,3 and 4 which are used for computa- 
tion in the following sections are therefore given in their explicit forms: 


( Ay 








Hp = n4(n— 1) (n— 2) (n— 3) (2n+1)(2n—1)’ ‘sie 
where 
Ag = 3(2m + 38) (2n + 2m + 3) {[4n? + (2m + 3) (2n + 2m + 8) (n+ 3)] (n+ 1) (n—2) 
+ 16n(n + 2m + 3)*}, 
Ags } 
Wp = (n+ 1) n4(n — 1) (n—2) (n—3)Qnt 1)(2n—1)’ le 
where 


Agg = 9(m + 2) (n+ m+ 2) {(n + 1) (n— 2) [— 2n? + (m+ 2) (n+ m + 2) {12(n + 4)? 
— 88(n + 4) + 125}] + (n+ 2m + 4)? [8(n + 4)®— 38(n + 4)? — 24(n +4) + 134]}, 


A 
w= (n +1) n4(n—1) (n—2) (n —3) (2n + 3) (2n+1)(2n—1)’ on 





where 
Aggy = 24(2m + 5) (2n + 2m + 5) {(m + 1) (n — 2) [2n? + (2m + 5) (2n + 2m + 5) {(n + 5)8 
— 12(n + 5)? + 44(n + 5) — 49}] + (n + 2m + 5)? [2(n + 5)# 
—17(n+5)3 + 20(n +5)? + 111(n +5) —224]}. 














Hence, 
pe) = 4(n + 2m +8 + 1)? (2n + 28)? (m — 1) (2n +1) (2:8) 
1 s{m+4(s+1)} {n+ m+ (s+ 1} (2n +8) (n— 2)? (2n + 2)?’ 
(n—1)(2n+1)A ’ 
pY = (2m + 3)? (2n + 2m + 3)2 (n+ 1? (n—2) (3) @n—1)’ (2-9) 
(n—1)(2n+1)A ’ 
PP = Sm +2 (w+ m +2) (On +3) (Qn—1) (w+ 1) (m2) (n—3) _— 
- (4) _ (n—1)(2n+1) Ay, (2:11) 


2° * 4/2m + 5)? (2n + 2m + 5)? (n+ 2)? (2n+ 3) (2n—1) (n+ 1) (n—2) (n—3)" 


It may be observed that the moments of U® can be obtained in a simple manner from 
those of V, another criterion which is defined as the sum of 0; = A,/(1+A,). In the numera- 
tor of any moment of V, if one maintains the coefficient of the highest power of n positive 
and put alternatively positive and negative signs for subsequent powers of n, then substitute 
for n the value m + +8 + 1, one obtains the numerator of the corresponding moment of U®, 
Similarly, the denominator of any moment of U® can be derived from the corresponding 
moment of V by putting positive coefficients for terms involving n and negative coeffi- 
cients for other terms in each linear factor and making the substitution of m+n+s8+1forn. 


3. THE UPPER PERCENTAGE POINTS OF THE DISTRIBUTION OF U® 


The moment quotients, 6% and £?, have been computed using (2-8) and (2-9) for parameters 

m = 1(0-5) 5(5) 30; 50 and n = 15(5) 50; 60, 80, 100 (except for a few values of n and smaller 

values of m). The upper 5 and 1 % points are then evaluated from ‘Tables of the percentage 

points of Pearson curves for given /, and £, expressed in standardized measure ’ (Pearson & 
Ir Biom. 46 
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Hartley, 1954, Table 42) and are shown in Tables 4 and 5 printed at the end of this 
paper. 
Hotelling (1931, 1951) has obtained the exact o.p.r. of U® in terms of incomplete 
£-functions and it is given below: 
l—w\"+!1 
(2n + 2m +4)! (=) 
2(2m + 1)! (2n+ 2)! 





P = I,(2m+ 2, 2n+3)— B,2(m+1,n+4 2), (3-1) 
where w = U®/(24+ U®), 
Pillai (1954, 1956) has suggested an approximation to the distribution of U® in the form 


[U@ysim+heo+n)-1 





p(U®) = (3-2) 


U@) sin+m+h(s+)}4+1 
B{s[m + }(s+1)], sn + 1} ssm+deo+} ( 1+ “| 


and the approximate c.p.F. for s = 2 can be shown to be 
P =1,,(2m+3, 2n+1). (3°3) 
A comparison of percentage points from the moment quotients with those from the exact 
and approximate ©.D.F.’s can be judged from Table 1. A study of these tables confirms 
Pillai’s observation (1954) that the error in using his approximate distribution is quite 
negligible for larger values of n; for example, for the upper 5% points, the approximate 
distribution could be used when n is 30 or more; for the upper 1 % points, when 7 is a little 
larger, say around 40. The percentage points from the moment quotients differ from those of 
the exact 0.D.¥. only in the third significant digits for large values of n, and appear relatively 
closer to the exact percentage points than the approximate percentage points. These 
observations justify the use of percentage points from the moment quotients or the use of the 
percentage points from the approximate o.p.F. for larger values of n. 


Table 1. Comparison of approximations to the wpper percentage points of U 











5% points 1% points 
- , From From a From From — 
exact approx. By B exact approx. By B 
C.D.F. O.D.F. vrs C.D.F. C.D.F. _—- 
0 5 1°43 1-39 — 2-17 2-05 —- 
0 10 0-671 0-664 — 0-979 0-931 — 
4 10 1-927 1-886 oo 2-516 2-415 — 
0 15 0-443 0°435 — 0-624 0-602 -- 
4 15 1-236 1-219 — 1-563 1-526 = 
0 20 0-328 0-323 — 0-455 0:443 -- 
3 
3- 
4 
5 
0 
3 
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4. UPPER PERCENTAGE POINTS OF THE DISTRIBUTION OF U) FOR CASES 8 = 3 AND 4 


The moment quotients, /, and £, have been computed for various values of the parameters 

mand n using (2-8), (2-10) and (2-11) for s = 3 and 4. The percentage points were then again 

evaluated from Table 42 of Pearson & Hartley (1954) and are shown in Tables 6-9. 
Making use of Pillai’s approximate c.p.F. given by expression (3-2), we have for s = 3, 


p =1,(3m+6,3n+1), where w= U®/(3+U®) (4-1) 
and for s = 4 
p=1,(4m+10,4n+1), where w= U®/(4+U®), (4-2) 


For comparison with the upper 5 and 1 % points from the moment quotients, percentage 
points were also evaluated for certain values of m and n from the approximate c.D.F. given 
in (4:1) and (4-2), The results are tabulated together with the corresponding percentage 
points from /, and f, in Tables 2 and 3. 


Table 2. Comparison of approximations to the upper percentage points of U® 























5% points 1% points 
m= 0 m= 5 m= 0 m= 5 

n 

From inte From Bowed From aan From fr 

By Bs C.D.F. By Bs C.D.F. By Bs C.D.F. By Bs C.D.F. 
15 — — 2-120 2-076 — — 2-560 2-462 
20 — — 1-557 1-533 — — 1-852 1-798 
25 — — 1-229 1-213 — — 1-449 1-415 
30 0-3621 0:3575 1-015 1-005 0°4635 0-4624 1190 | 1-168 
35 0°:3097 0°3055 0:8638 0:8571 0°3939 0:3867 1-009 0-9943 
40 +2692 -2671 *7520 *7483 +3412 +3376 0-8759 +8672 
45 +2387 +2373 -6660 -6636 +3028 +2995 -7736 -7680 
50 *2144 -2133 *5977 +5957 -2714 *2686 -6927 *6886 
60 | 0-1778 0-1774 0-4959 0-4936 0-2250 0:2227 0-5728 0-5693 
80 *1331 *1327 -3688 +3687 *1674 -1662 +4238 +4240 
100 -1062 -1060 -2949 +2947 +1333 +1328 +3384 +3382 

| 





























A studv of these tables shows that the percentage points from the two methods are close 
for larger values of n and hence the approximate distributions appear usable as follows: 





5% 





1% 
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Table 3. Comparison of approximations to the upper percentage points of U“ 

















5% points 1% points 
m= m= 5 m=0 m= 65 
n 
From Procnce From Rosco From Posed From Post a 
By Bs C.D.F. By Bs C.D.F. By Bs C.D.F. By Bs C.D.F. 
15 1-122 1-084 2-877 2-812 1-413 1-334 3-395 3-246 
20 0-8272 0-808 2-113 2-085 1-028 0-9841 2-458 2-387 
25 -6548 -6415 1-668 1-611 0-8069 -7800 1-925 1-881 
30 *5423 +5342 1-378 1-373 -6644 -6478 1-581 1-550 
35 0-4629 0-4572 1-174 1-172 0-5646 0-5530 1-341 1-329 
40 -4033 +3994 1-023 1-014 ‘4911 +4819 1-165 1-156 
45 +3574 +3544 0-9058 0-9035 -4343 +4264 1-029 1-021 
50 +3209 +3184 -8130 *8095 +3893 +3821 0-9218 0-9134 
60 0-2666 0-2651 0-6745 0-6738 0-3224 0-3180 0-:7627 0-7598 
80 +1990 +1984 +5030 +5039 +2399 +2375 +5670 -5674 
100 -1588 -1583 -4010 -4018 -1909 +1895 +4512 -4518 



































5. AN EXAMPLE 
The criterion U is useful for testing different kinds of hypotheses in multivariate analysis, 
one being the comparison of two independent estimates of the same dispersion matrix. 
A second problem in which this criterion can be used is in testing the equality of p-dimen- 
sional mean vectors of / p-variate normal populations (which is mathematically identical 
with the general problem of multivariate analysis of variance of means). The values of m and 
n appropriate for this test are 


m = 43|l—p-1|-}, n=}(N-l-p-1), (5-1) 
where N is the total of ] sample sizes. The following data are taken from Rao (1952, p. 263) 
concerning measurements of 140 schoolboys of almost the same age belonging to six different 
schools in an Indian city. Three characters were measured, namely, (1) head length, 
(2) height and (3) weight. The problem is to test for the significance of differences between 
schools in the mean characters. Let S*, S be the matrices consisting of the sums of squares 
and products ‘between’ and ‘within’ schools for the three characters. Then 


1 2 3 
752-0 2142 521-3\ 1 
S* = 151-3. 401-2] 2 (5-2) 
1612-7/ 3 
1 2 3 


S= 


1499-6 4123-6 
21,009-6 


12,809°3 1003-7 2671-2 
(5-3) 


on 
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The value of U® = 0-2016 is obtained as the trace of the matrix S-1S*, where S—! denotes 
the reciprocal of the S matrix. Referring to Tables 6 and 7, with m = 0-5 and n = 65, we find 
that this value of U® is just significant at the 5% level, which falls at about 0-195, and is 
clearly not significant at the 1% level, 0-242. The corresponding percentage points from 
Pillai’s approximate c.d.f. are 0-194 and 0-239, respectively. This agrees with the findings 
of Rao, who examined the data using the A criterion of Pearson & Wilks (1933). Foster 
(1957), however, finds that the largest root is significant only at the 15 % level. 

The fact that in this particular example different test functions based on the same roots 
give different results need not be regarded as surprising. Far too little is known at present 
about alternatives to the null hypothesis to which these different tests are most sensitive. 


The authors wish to acknowledge the facilities offered by the Statistical Center, University 
of the Philippines, during the course of preparation of this paper. 
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Table 4. Upper 5% points of the sum of two non-null roots, U@ 
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| 
“oe 20 25 30 35 | 40 45 50 60 80 100 
m 
| | 

~| — —_ —~ — — | — _ a — | 0116 | 0-092 
16) — _ — — 0-310 | 0-270 | 0-239 | 0-215 | 0-179 | -133 | -106 
2-0 — | 0-496 | 0-410 | -350 | -305 | -270 | -242 | -202 | -150 | -120 
25) — _ ‘551 | -456 | -389 | -339 | -300 | -269 | -224 | -167 | -133 
30 | — | 0-768 | -607 502 | -428 | -373 | -330 | -296 | -246 | -183 | -146 
35 | — | 0-842 | 0-662 | 0-547 | 0-466 | 0-406 | 0-360 | 0-323 | 0-268 | 0-200 | 0-159 
40} — 907 | +717 ‘592 | -505 | -439 | -389 | -349 | -290 | -216 | -172 
45; — 976 | -771 | -637 | -542 | -472 | -418 | -375 | -311 | -232 | -185 
50 | — 1045 | -824 | -681 580 | +505 | -447 | -401 | +332 | -248 | -197 
10 — 1-718 | 1-352 | 1-115 | 0-947 | 0-823 | 0-728 | 0-652 | 0-541 | 0-402 | 0-366 
15 | 3263 | 2-381 | 1-870 | 1-539 | 1-306 | 1-134 | 1-003 | -899 | -744 | -553 | -440 
20 | 4171 | 3-039 | 2-383 | 1-958 | 1-661 | 1-442 | 1-275 | 1-142 | -945 | -701 | -558 
25 | 5-077 | 3-692 | 2-894 | 2-374 | 2-014 | 1-749 | 1-545 | 1-383 | 1-143 | -848 | -674 
30 | 5-981 | 4345 | 3-403 | 2-792 | 2-366 | 2-053 | 1-813 | 1-622 | 1-341 | -994 | -790 

| | 
50 | 9590 | 6-947 | 5-430 | 4-449 | 3-767 | 3-266 | 2-881 | 2-577 | 2-127 | 1-573 | 1-248 

Table 5. Upper 1% points of the sum of two non-null roots, U 
"| 15 20 25 30 35 40 45 50 60 80 100 
™m | 
19 | — — — — — - _ = — | 0-148 | o-118 
| — — — — | 0-408 | 0-344 | 0-304 | 0-273 | 0-226 | -168 | -134 
20; — — | 0-632 | 0-520 | -442 | -384 | -339 | -303 | -251 | -187 | -149 
25); — — 697 | -572 | -485 | -422 | -372 | -334 | -276 | -205 | -163 
30 | — | 0-970 | -760 | -624 | -529 | -458 | -406 | -364 | -301 | -224 | -178 
35 | — 1-059 | 0-822 | 0-675 | 0-572 | 0-497 | 0-439 | 0-393 | 0-325 | 0-242 | 0-192 
40) — 1130 | -884 | +725 | -616 | -534 | -472 | -422 | -349 | -259 |  -206 | 
45 | — 1210 | -945 | -776 | -658 | -571 | -504 | -451 | +373 | -277 | -220 | 
60; — 1-288 | 1-005 | -825 | -700 | -607 | -536 | -480 | 396 | -294 | -234 | 
| 
10 — | 2-057 | 1-602 | 1-310 | 1-108 | 0-960 | 0-846 | 0-757 | 0-625 | 0-462 | 0-366 
15 | 3-934 | 2-812 | 2-183 | 1-782 | 1-505 | 1-302 | 1-147 | 1-024 | -845 | -624 | -495 | 
20 | 4-974 | 3-551 | 2-758 | 2-243 | 1-895 | 1-640 | 1-443 | 1-288 | 1-061 | -783 | -621 | 
25 | 6-043 | 4-302 | 3-330 | 2-712 | 2-286 | 1-974 | 1-736 | 1-549 | 1-275 | -940 | -745 
30 | 7-092 | 5-043 | 3-900 | 3-173 | 2-673 | 2-306 | 2-028 | 1-807 | 1-488 | 1-097 | -868 
| 
11-28 | 7-996 | 6-167 | 5-007 | 4-202 | 3-626 | 3-185 | 2-837 | 2-328 | 1-711 1-358 | 
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Table 6. Upper 5% points of the sum of three non-null roots, U® 
" 15 20 25 30 | 35 40 45 50 60 80 100 
m | 
| 0-0 — —_ — 0-362 | 0-309 0-269 0-239 0-214 0-178 0-133 0-106 
(05 — | 0-658 | 0-520 | -431 368 | -321 284 | +255 | -212 | -158 | -126 
10) — -761 603 | -499 | -425 | -371 | -329 | -295 | -245 | -183 | -146 
15 1-172 *864 -683 -566 -482 +420 +372 +334 +278 +207 165 
2-0 1-310 -964 *763 +632 +538 -469 -416 +373 +310 +231 -184 
25 | 1446 | 1-065 | 0-843 | 0-696 | 0-594 | 0-517 | 0-458 | 0-411 | 0-341 | 0-254 | 0-203 
3-0 | 1-581 | 1-164 | -921 | -761 649 | -565 | -500 | -449 | -372 | -278 | -222 
3-5 1-717 1-263 -998 +825 -703 -612 +542 -486 -403 +293 +240 
4-0 | 1-852 | 1-362 | 1-076 | -889 | -757 | -659 | -583 | -524 | -434 | -324 | -258 
4-5 | 1-986 | 1-459 | 1-153 | -952 | -810 | -706 | -625 | -561 | -465 | -347 | -277 
5-0 | 2-120 | 1-557 | 1-229 | 1-015 | -864 | -752 | -666 | -598 | -496 | -369 | -295 
10 3-438 2-517 1-982 1-634 1-391 1-210 1-071 0-961 0-796 0-593 0-472 
15 4-742 3-494 2-725 2-245 1-933 1-661 1-469 1-316 1-090 “811 646 
20 | 6-039 | 4-407 | 3-478 | 2-852 | 2-424 | 2-107 | 1-862 | 1-668 | 1-381 | 1-026 | -817 
25 6-933 5-080 4-003 3-303 2-811 2-445 2-163 1-940 1-607 1-196 *953 
30 | 8-168 | 5-981 | 4-711 | 3-886 | 3-306 | 2-875 | 2-543 | 2-278 | 1-888 | 1-406 | 1-120 
50 | 10-10 7-327 5°734 4-708 3-990 3-460 3-053 2-731 2-255 1-671 1-326 
| 
N.B. For m = —0-5, n = 100, the 5% point of U® is 0-085. 
Table 7. Upper 1% points of the sum of three non-null roots, U® 
"| 15 20 25 30 35 40 45 50 60 80 100 
™ 
0-0 — —_ _— 0-464 0-394 0-341 0-303 0-271 0-225 0-167 0-110 
0-5 — 0-837 0-658 -541 -459 -400 +353 +317 +262 “195 *156 
10 | — 956 | -750 | -617 | -524 | -456 | -403 | -361 299 | +223 | +177 
15 | 1-475 | 1-071 | -840 | -691 587 | 511 451 | -404 | -335 | -249 | -198 
20 | 1-634 | 1-186 | -930 | -765 | -649 | -564 | -499 | -447 | -370 | -275 | -219 
25 | 1-791 | 1-298 | 1-018 | 0-837 | 0-711 | 0-617 | 0-546 | 0-489 | 0-405 | 0-301 | 0-240 
3-0 | 1-947 | 1-410 | 1-106 | -909 | -771 | -670 | -592 | +531 | +439 | -326 | -260 
3-5 | 2-102 1-521 1-193 -980 *831 *722 638 *572 473 +339 +279 
4-0 | 2-252 | 1-632 | 1-278 | 1-050 | -891 174 | +684 | -612 | -506 | -376 | -299 
4-5 | 2-408 | 1-742 | 1-364 | 1-120 | -950 | -825 | -729 | -653 | -540 | -401 | -319 
5-0 | 2-560 1-852 1-449 1-190 1-009 *876 “774 693 +573 +424 +338 
10 4-060 2-925 2-283 1-871 1-583 1-372 1-211 1-084 0-895 0-664 0-528 
15 5-541 4-026 3-101 2-536 2-180 1-858 1-639 1-465 1-210 -896 “712 
20 7-009 5-030 3-938 3-196 2-701 2-338 2-061 1-842 1-520 1-124 +893 
25 7-838 5-658 4-419 3-618 3-066 2-658 2-345 2-098 1-732 1-285 1-021 
30 9-212 6-639 5-184 4-244 3-593 3-114 2-747 2-455 2-029 1-505 1-196 
3-803 3-344 















Table 8. Upper 5% points of the sum of four non-null roots, U® 


On Hotelling’s generalization of T? 






















































































































10 15 20 25 30 35 40 45 50 60 80 100 
| 
08 _ — | 0-712 | 0-547 | 0-453 | 0-387 | 0-337 | 0-299 | 0-268 | 0-223 | 0-167 | 0-133 
0-0} — 1-122 | -827 | -655 | -542 | -463 | -403 | -357 | -321 | -267 | -199 | -159 
| o5| — | 1-302} -961 | -761 | -630 | -537| -468 | -415| -372 | -309 | -231 | -184 
| — 1-482 | 1-092 | -865 | -716 | -610 | -531 | -471 | -426 | -851 | -262 | -209 
(oo, — 1-660 | 1-223 | -968 | -800 | -682 | -594 | -526 | -472 | -392 |) -293 | -234 
| 20| — 1-837 | 1-352 | 1-120 | -884 | -753 | -656 | -581 | -522 | -433 | -324 | -258 
2:5; — | 2-012 | 1-480 | 1-171 | 0-967 | 0-824 | 0-718 | 0-686 | 0-571 | 0-474 | 0-354 | 0-282 
| 3.0| — | 2-186 | 1-608 | 1-271 | 1-050 | -895 | -780 | -691 | -620| -515 | -384 |_ -306 
| 35| — | 2-359 | 1-735 | 1-371 | 1-132 | -963 | -841 | -745 | -669 | -555 | -414 | -330 
4-0} — | 2-532 | 1-862 | 1-479 | 1-214 | 1-035 | -902 | -799 | -717 | -595 | -444 | -354 
| 4.5| — | 2-710 | 1-988 | 1-569 | 1-296 | 1-104 | -962 | -852 | -765 | -636 | -473 | -378 
5-0} — | 2-877 | 2-113 | 1-668 | 1-378 | 1-174 | 1-023 | -906 | -813 | -674 | -503 | -401 
10 | 7-17 | 4-578 | 3-353 | 2-644 | 2-183 | 1-855 | 1-618 | 1-430 | 1-284 | 1-064 | 0-793 | 0-632 
15 | 9-84 | 6266 | 4-581 | 3-610 | 2-978 | 2-533 | 2-203 | 1-949 | 1-748 | 1-448 | 1-078 | -859 
20 | 1215 | 7-404 | 5-803 | 4-570 | 3-768 | 3-204 | 2-784 | 2-463 | 2-207 | 1-828 | 1-361 | 1-083 
25 | 15-15 | 9-622 | 7-021 | 5-526 | 4-553 | 3-869 | 3-363 | 2-974 | 2-665 | 2-207 | 1-641 | 1-306 
30 | 17-80 |11-30 | 8-238 | 6-481 | 5-337 | 4-533 | 4-050 | 3-464 | 3-121 | 2-583 | 1-920 | 1-528 
50 | 28-40 |17-98 |13-09 | 10-29 | 8-464 | 7-184 | 6-238 | 5-505 | 4-938 | 4-082 | 3-031 | 2-410 
Table 9. Upper 1% points of the sum of four non-null roots, U® 
| | | | 
"| 10 | 15 20 | 25 30 | 35 40 | 45 | 50 | 60 80 100 
m 
| | ) 
<4 ae ae | 0-908 | 0-687 | 0-565 | 0-480 | 0-418 | 0-370 | 0-331 | 0-274 | 0-204 | 0-163 
0-0; — 1-413 | 1-028 | -807 | -664 | -565 | -491 | -434 | -389 | -322 | -240! -191 
0-5 == 1-620 1-177 +925 -761 *647 +562 +497 +446 +369 +275 +219 
i me 3 1-824 | 1-325 | 1-040 | -856 | -727 | -632 | -559 | -501 | -415 | -309 | -246 
15| — | 2-025 | 1-470 | 1-154 | -949 | -807 | -701 | -620| -556 | -460 | -342 | -272 
20| — | 2-224 | 1-615 | 1-322 | 1-042 | -885 | -769 | -680 | -609 | -504 | -375 | -299 
25} — | 2-421 | 1-758 | 1-378 | 1-134 | 0-963 | 0-836 | 0-739 | 0-662 | 0-548 | 0-408 | 0-325 
3-0} — | 2-618 | 1-899 | 1-489 | 1-225 | 1-039 | -902 | -798 | -715 | -592 | -440 | -350 
35| — | 2-813 | 2-039 | 1-599 | 1-314 | 1-116 | -969 | -856 | -767 | -635 | -472 | -376 
4-0 a 3-008 2-180 1-708 1-402 1-191 1-034 “914 -819 -678 +504 -401 
4-5 —- 3-202 2-319 1-817 1-493 1-266 1-100 *972 *870 *722 +535 +426 
5-0 --- 3-395 2-458 1-925 1-581 1-341 1-165 1-029 +922 -763 -567 *451 
10 8°57 5-305 3-827 2-991 2-452 | 2-075 1-803 1-591 1-425 1-179 | 0-875 0-696 
15 | 11-66 | 7-189 | 5-177 | 4-038 | 3-309 | 2-802 | 2-480 | 2-144 | 1-919 | 1-585 | 1-175 | -984 
20 14-74 9-065 6-520 | 5-079 | 4-159 3-521 3-050 | 2-690 2-406 1-986 1-472 1-169 
25 | 17-81 |10-94 | 7-857 | 6-115 | 5-004 | 4-233 | 3-666 | 3-233 | 2-890 | 2-385 | 1-767 | 1-403 
30 | 20-88 |12-80 | 919 | 7-15 | 585 | 494 | 440 | 374 | 3-37 | 278 | 2-06 | 1-68 
7-77 =| 6-72 
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TABLES FOR WALD TESTS FOR THE MEAN OF 
A NORMAL DISTRIBUTION 


By ELIZABETH D. BARRACLOUGH anp E. 8. PAGE 
Durham University Computing Laboratory 


1. INTRODUCTION 

If x is a normally distributed random variable with unknown mean 6 and known standard 
deviation a, the Wald sequential test for the hypothesis 6 = 0, against the alternative 
6 = 0, (9, > Oo) is specified as follows (Wald, 1947, pp. 117 et seq.): 

Continue taking observations x; as long as 

<a n 
a< a Set 3 (OM) < b; (1) 

if the left-hand inequality first fails to be satisfied, stop sampling and accept 0 = 9, similarly 
accept 0 = 0, if the right-hand inequality fails. 

In practice the test is usually carried out either by plotting the cumulative sum 2 2; on 
a chart on which the parallel straight line boundaries are drawn and stopping sampling 
when one of the boundaries has been crossed or by comparing the cumulative sum after each 
observation with acceptance and rejection numbers calculated from (1). 


If yi = {2a,— (09+ 4,)}/20, (2) 
the inequalities (1) may be written 





—-Z< Dy; < h-Z, (3) 
i=1 
2 Re ge See 
where Z= 0,—0,' h= 0,0," (4) 
The variate y; is normally distributed with unit standard deviation and mean 
1 = {20 — (0) +0,)}/20, (5) 


where E(x) = 0. 

Let P(Z | 1) be the probability of accepting the hypothesis that 6 = 6, when the true mean 
has a particular value 6, and y is given by equation (5). The argument y will be omitted 
where no ambiguity is possible. The derivation of the equation for P(Z) given by Anscombe 
(1948) considers expectations conditional upon the first observation (Page, 1954a) and in 


this case yields h 
P(Z) = ®(—p—Z)+ [Pe (27)-t exp —}(x-Z—p)* dz, (6) 


where O(x) = 7 (27r)-4 e-4 dt. 


If w= $4(0,—4,)/o, P(Z | ) gives the probabilities of accepting 0 = 0, when E(x) = 9, 
and E(x) = 6,, respectively. The charts and Tables 1 a-d, of the Appendix enable h and Z 
to be selected to give specified values for these two probabilities. The constants of the test, 
a and 6, can then be calculated from equations (4). In Tables 1a-d, 


P_= P(Z| -4(0,—0,)/0) = 1-«, 
P, = P(Z| 4(0,— %)/0) = B. 
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If the required values of the operating characteristic are not among those tabulated, it 
may be sufficient for practical purposes to interpolate by eye in the charts provided. The 
values in the tables were those requested for a particular application, but the range covered 
is sufficiently wide to be of more general use. Further combinations of a and f can be obtained 
by using the relationships 

P(h—Z| —3(0,—9p)/0) = 1—P(Z | $0, —%)/0), 
P(h—Z| $(0,—9)/o) = 1—P(Z| — 3(0,—%)/0). 
Tables 2a-d, of the Appendix, computed from equation (9) below, give the average sample 
numbers, NV_ (when 6 = @,) and N, (when 6 = @,) of each one of these tests. 


2. THE METHOD OF USE OF THE CHARTS AND TABLES 
(a) To select a test with given risks 


If a test of the mean of a normal distribution with standard deviation o is required which has 
probability 1—a of accepting the hypothesis 0 = 6, when 0 = 4, and probability # when 
@ = @, (so that the risks of the first and second kinds are a, /, respectively) it may be found 
as follows. 

Calculate i», “4, where My = — fy = (09 —9,)/20. (7) 

Charts are given for ~= +0-25, +0-5, +0°75, +1-0, and there are curves for 
P(Z| u > 0) = 0-05, 0-10, 0-20, 0-30, 0-40, 0-50, 0-60, 0-70 and P(Z| mu < 0) = 0-95, 0-99, 
0-995, 0-999. 


Example 1 

To select a test with P(Z | 0, = 3-0) = 0-99, P(Z| 0, = 3-75) = 0-05 when o = 0°5. 

We have Mp = —/ty = (3°0—3-75)/2(0-5) = — 0-75. 
From Table 1c for ~ = + 0-75, h = 3-88; Z = 1-42. 

Hence a = — 2-13, b = 3-69 from (4). The required test is therefore to take observations as 
long as ~0-7143:375n < Da; < 1-234+3-375n. 


(b) Operating characteristics 


Several points on the operating characteristic (0.c.) may be obtained approximately by 
visual interpolation between the curves on the charts for the different values of . 


Example 2 


The approximate o.c. for the test selected in Example 1 is shown in Fig. 1 in which the | 


circled points are those read from the charts. 


(c) Average sample number 
The average numbers of observations required for the tests given in Table 1 when the mean 
is that specified by eitl er hypothesis are shown in Table 2. 
Example 3 


The average number of observations required by the test of Example 1 when 6 = 3-0 is 
N = 2-87 and when 0 = 3-75 is N = 4-00. 
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Fig. 1. Operating characteristic. x x, defining points of the test. 
OO, points read from the charts. 








3. CALCULATION OF THE TABLES AND CHARTS 


For a given pair of values of h and uv the solution P(Z) to (6) was computed by an iterative 
method (Page, 1954b; Good, 1957). The known function, the normal distribution function, 
was calculated by a rational function approximation (Hastings, 1952) with an error at most 
4x 10-6. The integral containing the unknown solution was replaced by a Gaussian quadra- 
ture formula using the smallest number of ordinates that would give a fairly accurate 
ised P(Z) = O(—p-2) +3 w,Ple,) Ke 2), (8) 
where w,, x; are respectively the Gauss weights and abscissae, and K(x, Z) is the kernel of (6). 
Equation (8) was used iteratively to obtain P(Z), for Z = x,, i = 1,..., n, starting from an 
initial approximation (usually zero). The iteration continued until successive values of the 
P(z;) all differed by less than a small quantity. At this stage equation (8) was applied for 
Z=y;,j =1,...,n’, where y; are the abscissae of a Gauss quadrature formula with more 
ordinates, n’ > n. The P(y;) so obtained formed the starting value for iterations with the 
more accurate formula. This process continued automatically until the P(Z) values at a set 
of Gauss points were reproduced to a prescribed accuracy by successive quadrature 
formulae. Values of P(Z) at other points were calculated and used by inverse interpolation 
to obtain estimated Z values for the given P(Z). These estimates were refined by substitution 
in (8) and repeating the process. 

Some of the pivotal values of the P(Z) were checked by an independent solution of (8) by 
the finite difference methods of Fox & Goodwin (1953). Limitations of storage space pre- 
vented attainment of the same accuracy of evaluation of the integral, but in no cese did the 
corresponding pivotal values differ by more than one unit in the fourth decimal place from 
those derived by the first method. 

The average sample number N(Z) satisfies the equation 


h 
N(Z) = 1+ N(z) (27)+* exp — }(~-—Z—p)* dz, (9) 
0 
which was solved by the first method for the tests quoted in Table 1. 
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4, WALD’s APPROXIMATIONS 
Wald’s approximation P*(Z) for the operating characteristic P(Z) of the test may be written 
P*(Z) = (e-*#" — e~2#2)/(e~2eh — 1); (10) 


accordingly the test calculated from this approximaticn to give risks «, £, i.e. so that 
P*(Z|—y)=1-a, P*(Z|u) = 


t= ye big (l-vA-A) 
has Z= 3,198 RB? et _ a aa (11) 
Wald also gives an approximation N*(Z) for the average sample number of the test. 
N*(Z | u) = (h{1—P*(Z|u)} —Z)/q. (12) 
Thus for the test above 
N*(Z| —p) = (Z—ha)|p, (13) 
N*(Z | w) = {h(1—f)—Z} Ix. (14) 


A comparison of P*(Z | ~) and P(Z | ) for one value of h, two values of Z and a range of 
was made by Page (1954a). The present table allows a more extensive comparison. Text- 
table 1 shows the Wald approximations a*, £* to the risks calculated from (10) for some tests 
with risks a, # at means +. For ~ = 0-25 the approximate risks of the second kind, /, are 
about one-third greater than their correct values, while for “7 = 1 they are more than three 
times greater. Further, for “ = 1, no approximations are possible when a = 0-001, # = 0°3, 
for example, since Z < 0 and (10) produces a result greater than unity. A similar behaviour 
is shown for risks of the first kind. It is clear that for any work requiring an accurate assess- 
ment of the risks for 4 > 0-25 the Wald approximation cannot be accepted. Further, some of 
the Wald app~oximations exceed the true 0.c. for ~ < Oif Z is small; these are not likely to 
occur for the most frequently used schemes with small « and /. 


Text-table 1 





| | Wald Wald 


| h Zz True | Wald | ‘True | A.S.N. A.S.N. 
M | | 0.c. 0.c. A.S.N. with with 
Wald o.c. | true o.c. 
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Comparison of exact and approximate risks 


The above comparison shows that tests selected by the Wald formulae to have specified 
risks will in fact usually have risks less than those specified by amounts depending largely 
upon the population mean. It would be useful to make an extensive comparison of the exact 
average sample numbers (A.S.N.) of the exact and approximate tests with specified risks, 
ie. those with h, Z, chosen from (6) and (8), respectively. This would, however, entail more 
computation than is warranted. Instead we compare the approximate A.s.Nn. for the exact 
test with values h, Z taken from the tables and the approximate a.s.N. for the approximate 
test with values h, Z given by (9) with the true values of the a.s.n. 

The approximate A.s.N. using the Wald approximation to the 0.c. is always smaller than 
the true value for the exact test and the difference is frequently considerable. If, however, 
the true 0.C. is used in (12) a better approximation to the true 4.s.N. is obtained, but it is still 
too small in most cases and in particular no such approximation is useful if Z < 0. For 
pf = 0-25, this approximation seems to yield an error of less than 10 %, but as yw increases the 
approximation deteriorates. 

Improved approximations to the 0.c. and a.s.N. have been derived by modifying the 
integral equations (6) and (9) (Page, 1954a) and more recently by a similar method by Kemp 
(1958). In the examples given, Kemp’s approximations to P(0), N(0) are usually nearer to 
the true values than Page’s* but the latter are closer approximations for a range of Z near the 
middle of (0, h). No further comparisons of these approximations have been made, nor of 
their quality over the wider range of schemes now available. 


We wish to thank Dr O. L. Davies and the Pharmaceuticals Division of Imperial Chemical 
Industries for their financial support for the preparation of the graphs. 
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APPENDIX 
Table 1 
0-999 0-995 0-99 0-95 
h Z h Z h Z h Z 
(a) # = 0-25 
0-70 10-80 — 0-03 7-57 — 0-04 6-17 — 0-05 2-81 —0-19 
“60 11-77 0:37 8-55 0-36 7-15 0-35 3-82 0-24 
-50 12-63 0-78 9-40 0-78 8-01 0-76 4-70 0-67 
40 13-45 1-25 10-23 1-24 8-84 1-23 5-53 1-15 
0-30 14-22 1-83 11-12 1-82 9-72 1-81 6-42 1-73 
20 14-98 2-64 12-19 2-63 10-80 2-62 7-50 2°53 
10 -- — 13-78 4-01 12-42 4-00 9-12 3-92 
05 _— — 14-90 5-40 13-87 5-39 10-61 5-31 
(b) w= 05 
0-70 442 | —0-71 279 | —0-72 2-08 | —0-74 0:30 | —0-95 
-60 5-02 — 0-39 3°40 — 0-40 2-69 — 0-42 0-97 — 0-54 
+50 5-54 — 0-09 3°93 — 0-10 3-22 —0-11 1-54 —0-19 
40 6-04 0-22 4-42 0-22 3-72 0-21 2-05 0-15 
0-30 6-55 0-57 4-93 0-57 4-23 0-56 2-57 0-51 
20 7:13 1-02 5-51 1-02 4:81 1-01 3°16 0-97 
10 7:95 1-73 6-34 1-72 5-64 1-72 3°99 1-68 
05 8-69 2-42 7-08 2-41 6-38 2-41 4-73 2-37 
(c) # = 0-75 
0-70 2-11 —1-12 1-01 —1-15 0-56 —1-18 some a 
-60 2-59 —0-82 1-50 — 0-84 1-03 — 0-86 — _ 
-50 3-02 — 0-55 1-93 — 0-56 1-46 — 0-57 0-27 — 0-69 
-40 3-42 —0-27 2-34 — 0-28 1-87 — 0-29 0-71 — 0:37 
0-30 3-83 0-03 2-75 0-03 2-28 0-02 1-14 — 0-04 
20 4-28 0-40 3-20 0-40 2-74 0-39 1-62 0-35 
“10 4-90 0-94 382 | 0-94 3°36 0-93 2-25 0-90 
05 5-42 1-42 4-34 1-42 3-88 1-42 2-78 1-39 
(d) w = 1-0 
0-70 0:85 | —1-45 —e ss sais oes — — 
-60 1-26 —1-16 0-47 — 1-20 0-11 — 1-24 _ — 
-50 1-64 — 0-90 0-83 — 0-92 0-47 — 0-94 — _— 
. — 0-64 
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Table 2 
0-999 0-995 | 0-99 | 0-95 
| | 
N_ N, N_ N, N_ N, | NL N, 
(a) wp = 0-25 
0-70 3:15 | 12-00 3-00 816 2-84 6-53 2-00 2-92 
-60 432 | 1699 | 415 | 11-86 3-97 9-67 2-97 4-72 
-50 5-75 | 22-34 5:56 | 15-92 5:37 | 18-17 4-23 6-90 
-40 7-53 | 28-00 7-32 | 20-31 7-11 | 17-00 5-84 9-41 
0-30 9-82 | 33-72 9-61 | 25-05 9-38 | 21-18 7-97 | 12-27 
20 | 1306 | 3910 | 1283 | 3017 | 1258 | 25-74 | 11:00 | 1551 
-10 ~ ~ 18-34 | 35:69 | 18-06 | 30:82 | 1622 | 19-27 
05 bs on 23-84 | 37-43 | 23:54 | 3351 | 21-46 | 21-46 
(b) p= 05 
0-70 1-29 3-35 1-25 2-39 1-21 1-99 1-04 Ll 
-60 1-49 4-53 1-45 3-25 1-41 2-71 1-18 1-49 
-50 1-77 5-83 1-73 4-22 1-68 3-53 1-41 1-97 
-40 2:16 7-22 2-11 5-29 2-05 4-47 1-74 2-57 
0-30 2-69 8-71 2-63 6-47 2-58 5-50 2-22 3-27 
-20 3-48 | 10-32 3-42 7-74 3-35 6-64 2-96 4-08 
10 4-86 | 12-06 4-80 9-16 4-72 7-91 4-26 5-02 
05 6-25 | 13-00 6-18 9-95 6-10 8-63 5-58 5-58 
(c) w = 0-75 
0-70 1-05 1-80 1-04 1-38 1-02 1-21 = = 
-60 1-10 2-28 1-08 1-71 1-07 1-47 me oe 
-50 1-18 2-81 1:16 2-10 1-14 1-7 1-08 1-12 
-40 1-29 3-40 1-27 2-55 1-25 2-18 1-12 1-35 
0:30 1-47 4-05 1-44 3-05 1-42 2-62 1-27 1-63 
-20 1-76 4-75 1-73 3-61 1-71 3-11 1-53 1-97 
10 2-33 5-52 2-30 4-23 2:27 3-68 2-06 2-39 
05 2-94 5-94 2-91 4-59 2-87 4-00 2-64 2-64 
(d) w= 1-0 
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Chart I, ~w=0-25 
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TABLES OF RANDOM OBSERVATIONS FROM 
STANDARD DISTRIBUTIONS 


By M. H. QUENOUILLE 


Research Techniques Unit, London School of Economics 


PURPOSES OF THE TABLES 


The. recent increase in the popularity of Monte Carlo methods has been accompanied by 
a corresponding increase in the supply of random observations. These are now available not 
only in the original form of random numbers (Kendall & Babington Smith, 1939; Tippett, 
1927; Rand Corp. 1955) but also as random normal deviates (Wold, 1954), correlated random 
normal deviates (Fieller, Lewis <: Pearson, 1955) and serially correlated random numbers 
and normal deviates (Kendall, 1949). 

From these published tables, it is easily possible to draw random observations from any 
distribution, the only steps involved being the calculation of the distribution function and 
the transformation of rectangularly distributed observations using this function. Neverthe- 
less, these two steps may require considerable calculations, and it is therefore convenient to 
have readily available sets of random observations from some standard distributions. These 
are provided in this table. 


CONTENTS OF THE TABLES 


For Monte Carlo methods where the purpose is to investigate the sampling effects of de- 
partures from the normal (or any other standard) distribution, it is likely in most instances 
that the greatest information will be obtained by relating estimated values for the non- 
normal observations to the corresponding values obtained with the same observations 
transformed to normality. The table has therefore been arranged so that the values in each 
line provide identical percentiles for each of eight different distributions each with a mean 
of zero and a second moment of unity. j 

One thousand random observations from each distribution are provided, and these are 
arranged in twenty groups of fifty. The basic data for these have been drawn from the first 
two pages of Wold’s (1954) Random Normal Deviates, and are given in the first column, «,, of 
each page. The further columns have been derived as follows. 


(a). 2%, random rectangular deviates from the distribution 
f(t_)da, = 5—7,d%, —/3 <a, < V3. (1) 
These were obtained by transforming the normal deviates, x,, by 
Ly 1 
2, = 24/3] [" Tea ox ~ tte, ~ 4]. 


In this calculation, the expression in the bracket was carried to four decimal places and 
multiplied by 3-4641. The answer was rounded off to two decimal places. 
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(b). x3, random deviates from a distribution whose logarithm was normally distributed 


1 
(x3) dx, = ——— 
Hea) Os = Tanya +a) 
where a = (e—1)-* = 0-76287 and b = 0-5—log,a = 0-771. These were obtained by trans- 
forming the normal deviates, 2,, by 
ag = (e%—e#)/,/(e2 —e) = 0-46271 e% — 0-76287. 
This gives a lower limit for x, of 0-763 and a modal value of — 0-593. In making this trans- 
formation, e%: was calculated to three decimal places and the value of x, rounded off to two 
decimal places. 
(c). 24, random deviates from the exponential distribution 


f(a) da, = e“@*Ydx, (x, > —1). (3) 


These were obtained by transforming the normal deviates, x,, by 


= ~log,| [” + Jean Jan? - jetde,|—1. 


(d). 25, %,X,, random deviates from an Edgeworth “es A expansion 


exp —}[log,(%3+a)+b} dx, (x3 > —a) (2) 


f(x) dz = exp -3 Ds+"4 1>'|< exp — 42°dz, (4) 


V(27) 
with 7;: Kz = 0-5, ky = 0-0, with 2: kK; = 0-0, Ky = 0-5 and with 2,: kz = 0-5, kK, = 0-5. 

These have been calculated using Cornish—Fisher expansions which give a sufficient degree 
of approximation within the central range of observations*. The expansions used, derived 
by substitution in formula (6-54) of Kendall and Stuart (1958), were 

124,416, = —9552+ 127,225a, + 782424 — 4023 + 5762} — 2522, 
1536x, = 141 1a, + 562} — 327, 
124,4162, = —12,144+ 122,878x, + 14,3047 — 10662} — 7202 + 26124. 
Tabulated values of these functions are given on page 182. 

It is clear that these (or any other polynomial) expansions will break down for sufficiently 
extreme values of x, and the fact that tabulated values of x; reach a minimum near 
2, = — 2-5 indicates the unreliability of the series expansion for x; beyond this point. To 
preserve the monotonic relationship between x, and x;, the values of x; corresponding to 
three more extreme values of x, (— 2-79, — 2-76, — 2-69) have been replaced by the minimum 
value for x;, — 1-86. These replacements have been indicated with an asterisk. The original 
values, should they be needed, are respectively — 1-81, — 1-82, — 1-84. 

A further limitation of the polynomial expansions is that values of cumulants of the 
distribution will not exactly equal the values of x, and x, inserted in the Edgeworth expan- 
sion. Thus the true values of the third and fourth cumulants (evaluated by taking expecta- 
tions of powers of the polynomial expansions) are: 

















| | 
| X- XL | Xn 
pens) oy hod | — | 
Third cumulant | oat | 0-00 | 0-50 
Fourth cumulant | 0-01 0-45 0-56 
| | 





* See note by E. S. Pearson on pp. 203-4 below. 
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(e). 2, random observations from the two-sided exponential distribution 


Fls)azy = 5" exp (— 98) dy (—00 < % < 0). (5) 


These were obtained by transforming the normal deviates, :r,, by 


%, = —" foe. | us a3} exp — }ajda,+ log.2| F 
The values were calculated to four decimal places and rounded off to two decimal 
places. 

All calculations were repeated (in many instances by the same computer) to provide 
a check. A further check was provided by punching each row of results on a Hollerith card 
and ordering the set of these according to values of z,. All other variables should then be 
arranged in order. 

This check revealed (apart from a number of errors in punching the cards) four or five 
omissions of minus signs. No gross error was found. 


PROPERTIES OF THE DISTRIBUTIONS 


The theoretical means and variances were, of course, zero and unity. The overall observed 
values showed close agreement with these theoretical values: 





| Lo Xo 3 Xs, Xs Xs Ly Xg 

| ; Halse, a 
Mean | 0:00 | 0-00 | —0-02 —0-01 | 0-00 | 0-00 | 0-00 | 0-00 
Second moment about origin | 0:95 | 0-98 | 0-81* 0-93 | 0-96 | 0-95 | 0-95 | 0-93 
| | 



































Theoretical values of the cumulants of the different distributions are shown in the 
following table: 





























| x, | Xq | 3 Xs, Xs X- Xq Xs 
| | = |_ 
| | 
Ks | 00 | OO | 6-2 20 | 05 | 00 | O65 0-0 
kK, | 00 | —1-2 | 110-9 60 | 00 | O5 | 06 3-0 
ks | 00 | 0-0 5154-7 240 | 00 | 00 | 00 0-0 
| | | 
Ke | 0-0 | 6-9 | 617375 1200 | 00 | 00 | 00 | 300 








The variations in the forms of distributions are fairly well demonstrated by the following 
frequency table for the whole group of observations: 


* Owing to the high value of «x, for this distribution, this seemingly extreme value corresponds to 
a two-tailed probability of greater than 0-5. 
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Values of the transformations for the Edgeworth Type A distributions 




















vy x_* x3 az Xs X le] Xe 

8-00 to 8-99 1 

7:00 to 7:99 2 

6-00 to 6-99 1 . 

5:00 to 5-99 0 3 ; 

4:00 to 4-99 5 2 . 1 

3-60 to 3-99 2 4 1 3 

3-20 to 3°59 ‘ 5 7 3 1 3 0 

2:80 to 3-19 3 3 4 2 3 1 5 

2-40 to 2-79 3 4 5 ll 7 13 8 

2:00 to 2-39 14 ; 5 23 10 1l 8 7 

1:60 to 1-99 29 34 20 18 33 27 33 24 

1:20to 1-59 62 117 18 43 60 58 58 40 

0-80 to 1:19 100 122 43 59 87 86 79 70 

0:40 to 0-79 131 117 70 78 120 136 116 124 

0:00 to 0°39 156 108 128 121 145 169 146 216 
—0-40 to —0-01 152 120 296 182 154 162 167 210 
—0:80 to —0-41 150 | 110 397 293 154 154 174 152 
—1-20 to —0-81 96 141 . 158 117 86 112 55 
— 1-60 to —1-21 48 95 . . 66 44 56 32 
—2:00 to —1-61 30 36 . , 38 27 26 21 
—2-40 to —2-01 20 : ‘ ; ‘ 17 5 12 
—2-80 to —2-41 6 ‘ ‘ me , 9 2 12 
—3-20 to —2-81 : : ; 5 ; 3 ‘ 5 
—3-60 to —3-21 i ; . : 4 ; ‘ 1 
—4-00 to —3-61 ; : ‘ 
































* The expected numbers in the middle eight groupings here are 115-47. The two end groups have 
expected numbers 38-12. 
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Frequencies of the sets of 1000 random observations 































































































1 
(a) 23 = <—— [ — 9552 + 127,225a + 782422 — 4023 + 57624 — 25225] 
124416 

x Xs x Xs x Xs x Xs x Xs 
—3-2 $ -1-9 | —1-680 | —0-6 | —0-667 | 0-7 | 0-670 | 20 | 2-227 
—31 -1-8 | —1-625 | -—05 | -0-572 | 08 | 0-782 | 21 | 2-352 
—3-0 | -1-7 | —1-564 | -0-4 | -—0-476 | 0-9 | 0-896 | 22 | 2478 
—2-9 -16 | —1-499 | -03 | -0378 | 10 | 1011 | 23 | 2-603 
—2-8 | —15 | —1-429 | -02 | -0-279 | 1-1 | 1-127 | 24 | 2-728 
—2-7 -14 | —1-356 | -01 | -—0178 | 1-2 | 1-245 | 25 | 2-851 
—2-6 -1-3 | —1-278 0 —0-077 | 1:3 | 1-364 | 26 | 2-972 
-25 | —1-857 | —1-2 | —1-198 0-1 0-026 | 1-4 | 1-484 | 27 | 3-092 
—24 | —1-849 | -1-1 | -1-115 0-2 0-130 | 15 | 1-606 | 28 | 3-208 
—23 | —1-832 | -1-0 | —1-029 0-3 0-236 | 16 | 1-728 | 29 | 3-322 
—22 | —1-806 | -09 | —0-942 0-4 0-342 | 1-7 | 1-852 | 3-0 | 3-431 
—21 | —1-771 | -—08 | —0-852 0-5 0-450 | 18 | 1-976 | 3-1 | 3-536 
—20 | —1-729 | -—0-7 | —0-760 0-6 0-560 | 1:9 | 2101 | 32 | 3-635 

(b) : [141llx + 5623 — 325] 
«4 =— _ 
6" 1536 

+z +2, +2 +X, +2 +X, +2 +X, +2 +X, 
0-0 0-000 0-7 0-655 1-4 1-376 | 21 | 2187 | 27 | 2918 
0-1 0-092 0-8 0-753 1-5 1486 | 22 | 2309 | 28 | 3-036 
0-2 0-184 0-9 0 352 1-6 1-599 2-3 | 2-431 | 29 | 3-153 
03 0-277 1-0 0-953 1-7 1713 | 24 | 2553 | 30 | 3-266 
0-4 0-370 1-1 1-056 18 1829 | 25 | 2675 | 31 | 3-375 
0-5 0-464 1-2 1-160 1-9 1-947 26 | 2797 | 32 | 3-479 
0-6 0-559 1-3 1-267 2-0 2-066 



















N.B. Negative values of z give negative values of x,. 


(c) a = [— 12,144 + 122,878x + 14,3042? — 106623 — 72024 + 26125] 


1 
124,416 
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TABLE OF STANDARDIZED RANDOM DEVIATES 

















First fifty 
vy Xv Xs Xs vs X, x vw 
1 — 0-84 — 1-04 — 0-56 — 0-78 — 0-89 —0-79 — 0-84 — 0-65 
2 1-37 1-44 1-06 1-46 1-45 1-34 1-44 1-25 
3 —0-18 — 0-25 — 0-38 — 0-44 — 0-26 —0:17 — 0-27 —0-11 
4 0-35 0-47 —0-11 0-01 0-29 0-32 0-26 0-23 
5 2-82 1:72 7-00 5-03 3-23 3-06 3-42 3°78 
6 2-12 1-67 3-09 3-07 2-38 2-21 2-40 2-39 
7 — 0-99 —1-:17 — 0-59 — 0-82 — 1-02 — 0-94 — 0-96 — 0-80 
8 0-34 0-46 —0-11 0-00 0-28 0-31 0-25 0-22 
9 0-64 0-83 0-11 0-34 0-60 0-60 0-58 0-46 
10 0-11 0-15 — 0-25 — 0-22 0-04 0-10 0-01 0-06 
11 — 0-02 — 0:03 — 0-31 — 0-32 —0:10 | —0-02 — 0-12 —0-01 
12 — 0-86 — 1-06 — 0-57 — 0-78 —0-91 —0:81 — 0-86 — 0-67 
13 0-01 0-01 — 0-30 — 0-30 — 0:07 0-01 — 0-09 0-01 
14 — 0-03 — 0-04 —0-31 — 0-33 —0-11 — 0-03 —0:13 — 0-02 
15 —0-41 — 0:55 — 0-46 — 0-58 — 0-49 — 0-38 — 0-48 — 0-27 
16 0-62 0-81 0-10 0-32 0-58 0-58 0-56 0-44 
17 0-83 1:03 0-30 0-59 0-82 0-78 0-79 0-64 
18 — 0-78 — 0-98 — 0:55 — 0-75 — 0-83 —0-73 — 0-80 — 0-59 
19 0-03 0-04 — 0-29 — 0-28 — 0-05 0-03 — 0-07 0-02 
20 — 2-30 —1-70 —0-72 — 0-99 — 1-83 — 2-43 — 1-95 — 2-72 
21 0-78 0-98 0-25 0-52 0-76 0-73 0-74 0-59 
22 0-66 0-85 0-13 0-37 0-63 0-62 0-60 0-48 
23 — 0-34 — 0:46 — 0-43 — 0-54 — 0-42 —0-31 — 0-42 — 0-22 
24 1-16 1-31 0-71 1-10 1-20 1-12 1-18 0-99 
25 0-76 0-96 0-23 0-50 0-74 0-71 0-71 0-57 
26 — 1-00 —1-18 — 0-59 — 0:83 — 1-03 — 0-95 — 0-97 —0-81 
27 — 0-32 — 0-43 — 0-43 — 0-53 — 0-40 — 0-30 — 0-40 — 0-20 
28 0-18 0-25 —0-21 —0-15 0-11 0-17 0-08 0-11 
29 0-08 0-11 — 0-26 — 0-24 0-01 0-07 — 0-02 0-05 
30 1-98 1-65 2-59 2-73 2-20 2-04 2-22 2-15 
31 0-91 1-10 0-39 0-71 0-91 | 0-86 0-89 0-72 
32 — 0-32 — 0-43 — 0-43 — 0-53 — 0-40 — 0-30 — 0-40 — 0-20 
33 =1-79 — 1-60 — 0-68 — 0-96 —1-61 —1-79 — 1-53 —1-81 
34 0-16 0-22 — 0-22 —0-17 0-09 0-15 0-06 0-10 
35 0-79 0-99 0-26 0-54 0:77 0-74 0-75 0-60 
36 0-20 0-27 — 0-20 —0:13 0-13 0-18 0-10 0-12 
37 1-31 1-40 0-95 1-35 1:38 1:28 1:37 1-17 
38 0-35 0-47 —0-11 0-01 0-29 0-32 0-26 0-23 
39 0:74 0-94 0-21 0-47 0-72 0-69 0-69 0-55 
40 0-27 0-37 —0-16 — 0-07 0-20 0-25 0-18 0-17 
41 1-39 1-45 1:09 1:50 1-47 1-37 1:46 1-28 
42 —0-14 —0-19 — 0:36 —0-41 — 0-22 — 0-13 — 0-23 — 0-08 
43 — 0-76 — 0-96 — 0°55 — 0:75 — 0-82 —0-71 — 0-78 — 0-57 
44 0-37 0-50 — 0-09 0-03 0-31 0-34 0-28 0-24 
45 — 2-28 — 1-69 —0-72 — 0-99 — 1-83 — 2-41 — 1-94 — 2-68 
46 0-36 0-49 — 0-10 0-02 0-30 0-33 0:27 0-23 
47 1-37 1-44 1-06 1-46 1-45 1-34 1-44 1-25 
48 1-04 1-22 0-55 0-90 1:06 0-99 1-04 0-86 
49 — 0-67 — 0:86 — 0:53 —0-71 — 0-73 — 0-63 —0-71 — 0-49 
50 0-39 0-53 —0-08 0-05 0-33 0-36 0:30 0-25 
L(x) 10-48 11-51 8-42 9-48 10-71 10-17 10-36 9-31 
X (a?) 51-4936 | 46-6287 | 76-3842 | 63-9778 | 63-0095 | 52-9419 | 53-8870 | 56-9311 












































184 


TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 























Second fifty 
a | X x v vs X 4 Xs 
1 0-68 0-87 0-15 0-39 0-65 0-64 0-62 0-49 
2 | -0-77 —0-97 — 0-55 —0-75 — 0-82 —0-72 —0-79 — 0-58 
3 | —1-39 — 1-45 — 0-65 0-91 1:35 —1:37 — 1-26 — 1-28 
4 | -1-91 — 1-63 — 0-69 —0-97 — 1-68 — 1-96 — 1-64 — 2-04 
5 0-05 0-07 — 0-28 —0-27 — 0-03 0-05 — 0-05 0-03 
6 1-32 1-41 0:97 1:37 1:39 1-29 1:38 1-19 
7 | —0-67 — 0-86 — 0-53 -0-71 —0-73 — 0-63 -0-71 — 0-49 
8: | —0-81 —1-01 — 0-56 -0-77 — 0:86 — 0-76 — 0-82 — 0-62 
9 0-96 1-15 0:45 0-78 0-97 0-91 0-95 0:77 
| 10 | —0-24 — 0-33 — 0-40 — 0-48 ~ 0-32 — 0-22 — 0-33 — 0-15 
11 | —0-66 — 0-85 — 0-52 -0-71 —0-72 — 0-62 —0-70 — 0-48 
12 1-08 1-25 0-60 0-97 1-10 1-04 1-09 0-90 
13 0-27 0-37 —0-16 —0-07 0-20 0-25 0-18 0-17 
14 0-46 0-61 — 0-03 0-13 0-41 0-43 0-38 0-31 
15 | -0-77 —0-97 — 0-55 —0-75 — 0-82 —0-72 —0-7 — 0-58 
16 0-00 0-00 — 0-30 -0-31 —0-08 0-00 —0-10 0-00 
17 1-01 1-19 0-51 0:86 1-02 0-96 1-00 0:82 
18 | —0-92 -1l1l — 0-58 — 0-80 — 0-96 — 0-87 -0-91 —0-73 
19 098) | 117 0:47 0-81 0-99 0:93 0:97 0-79 
20 0-24 0:33 —0-17 —0-10 0-17 0-22 0-15 0-15 
21 1-01 1-19 0:51 0:86 1-02 0-96 1-00 0-82 
22 1-49 1-50 1-29 1-69 1-59 1-48 1-59 1-41 
23 1-16 1-31 0-71 1-10 1-20 1-12 1-18 0-99 
24 0-48 0-64 — 0-02 0-15 0-43 0:45 0-40 0-33 
25 0-40 0-54 — 0-07 0-07 0-34 0:37 0-32 0-26 
26 | -0-12 0-17 — 0-35 —0-40 — 0-20 -O11 —0-21 —0-07 
27 | —0-85 — 1-05 — 0-57 —0-78 — 0-90 —0-80 — 0-85 — 0-66 
28 | —0-46 —0-61 —0-47 —0-61 — 0-53 — 0:43 — 0-53 —0-31 
29 0:35 0:47 -O11 0-01 0-29 0-32 0-26 0-23 
30 0-23 0-32 —0-18 -O11 0-16 0-21 0-14 0-14 
31 0-20 0-27 — 0-20 —0-13 0-13 0-18 0-10 0-12 
32 | -0-17 — 0-23 —0-37 — 0-43 — 0-25 —0-16 — 0-26 — 0-10 
33 0-12 0-17 — 0-24 —0-21 0-05 0-11 0-02 0-07 
34 | —1-48 — 1-49 — 0-66 —0-93 -1-41 — 1-46 — 1-32 — 1-40 
35 0-52 0-69 0-02 0-20 0:47 0:48 0-45 0-36 
36 1-56 1-53 1-44 1-82 1-68 1-55 1-68 1-51 
37 1-04 1-22 0-55 0-90 1-06 0-99 1-04 0:86 
38 | —0-18 — 0-25 — 0-38 —0-44 — 0-26 —0-17 —0-27 -O11 
39 «| —0-26 — 0-36 —0-41 —0-49 — 0-34 — 0-24 — 0-35 —0-16 
40 1-00 1-18 0-49 0-84 1-01 0-95 0-99 0-81 
41 | —0-51 —0-68 —0-49 —0-64 — 0-58 —0-47 —0-57 — 0-35 
42 0-05 0-07 — 0-28 —0-27 — 0-03 0-05 — 0-05 0-03 
43 | —0-69 — 0-88 — 0-53 —0-72 —0-75 — 0-65 —0-72 — 0-50 
44 | —0-58 — 0-76 — 0-50 —0-67 — 0-65 — 0-54 — 0-63 —0-41 
45 | —0-69 — 0-88 —0:53 | —0-72 —0-75 — 0-65 —0-72 — 0-50 
46 | —1-41 — 1-46 -0-65 | —0-92 — 1-36 —1-39 —1-27 — 1-30 
47 0-24 0-33 -0-17 | —0-10 0-17 0-22 0-15 0-15 
48 0-41 0-55 -0-07 | 0-08 0-35 0-38 0-33 0:27 
49 0-15 0-21 -0-23 | -018 0-08 0-14 0-05 0-09 
50 | —0-24 —0-33 —0-40 | — 0-48 — 0-32 — 0-22 —0-33 —0-15 
L(zx) 1-68 2-28 — 5-69 | —3-80 0-23 1-52 0-24 1-10 
L(x) | 32-9330 | 40-9668 | 13-6407 | 26-0324 | 33-5593 | 31-0336 | 31-6978 | 25-2532 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 

































































Third fifty 
| | 

x X %3 %, vs | X, Ly Xs 

1 0-11 0-15 — 0-25 — 0-22 0:04 0-10 0-01 0:06 

2 — 0:89 — 1-09 — 0:57 —0-79 —0-93 — 0-84 —0:88 —0-70 

3 0-99 1-17 0:48 0:83 1-00 0-94 0-98 0-80 

4 0-50 0-66 0-00 0-18 0:45 0:46 0-42 0°34 

5 — 0-95 —1-14 —0:58 —0-81 —0-99 —0-90 —0-93 —0-76 

6 0:81 1-01 0:28 0-57 0:79 0-76 0:77 0-62 

7 — 0-28 — 0:38 —0-41 | —0-51 — 0-36 — 0-26 — 0-36 —0-18 

8 — 1-64 — 1-56 —0-67 | —0-95 —1-53 — 1-64 — 1-44 — 1-62 

9 — 1-44 —1-47 —0-65 | —0-92 —1-39 — 1-42 — 1-29 — 1-34 

10 0-01 0-01 — 0:30 — 0-30 —0-07 0-01 — 0-09 0-01 
11 0:24 0-33 —0-17 —0-10 0:17 0:22 0-15 0-15 
12 0:46 0-61 — 0:03 0-13 0-41 0:43 0:38 0-31 
13 0-02 0-03 — 0-29 — 0-29 — 0:06 0-02 —0-08 0-01 
14 — 2-09 — 1-67 —0-71 —0-98 — 1-97 —2-17 —1-78 — 2-34 
15 2-08 1-67 2-94 2-97 2-33 2-16 2-35 2-32 
16 — 0-80 — 1-00 — 0-56 — 0-76 — 0-85 —0-75 —0-81 —0-61 
17 0-27 0°37 — 0-16 — 0-07 0:20 0-25 0-18 0:17 
18 0-21 0-29 —0-19 —0-12 0-14 0-19 0-11 0-13 
19 — 1-33 —1-41 — 0-64 — 0-90 — 1-30 — 1-30 —1-21 — 1-20 
20 1:70 1:58 1:77 2-11 1:85 1-71 1-85 1:71 
21 — 0-92 -1-11 — 0:58 —0:80 | —0-96 — 0:87 —0-91 —0-73 
22 1:73 1:59 1-85 217 | 1-89 1:75 1:89 1-75 
23 0-66 0:85 0-13 0-37 0-63 0:62 0:60 0-48 
24 — 1-69 — 1-57 — 0-68 — 0-95 — 1-56 —1-70 — 1-47 —1-19 
25 2-13 1-67 3-13 3-10 2-39 2-22 2-42 2-41 
26 — 2-20 — 1-68 —0-71 —0-99 —1-81 —2-31 — 1-87 — 2-53 
27 1-57 1:53 1-46 1-84 1-69 1-57 1-69 1-52 
28 — 1-85 — 1-62 — 0-69 — 0-97 — 1-65 — 1-89 — 1-59 — 1-94 
29 — 2-24 — 1-69 —0-71 —0-99 — 1-82 — 2-36 — 1-90 —2-61 
30 —0-15 —0-21 — 0:36 — 0-42 — 0-23 —0-14 — 0-24 — 0-09 
31 — 0-45 — 0:60 — 0:47 — 0-60 — 0-52 — 0-42 — 0:52 — 0:30 
32 — 0-03 — 0-04 —0-31 — 0-33 —0-11 — 0-03 —0-13 — 0-02 
33 1-01 1-19 0-51 0-86 1-02 0-96 1-00 0-82 
34 1-19 1:33 0:76 1-15 1-23 1-15 1-22 1-03 
35 | —1-03 —1-21 — 0-60 — 0-84 — 1-05 —0-98 — 0:99 — 0-84 
36 0-35 0:47 —011 0-01 0-29 0-32 0:26 0-23 
37 — 0-82 — 1-02 — 0:56 —0-77 — 0-87 —0:77 — 0:83 — 0-63 
38 1-76 1:60 1:93 2-24 1-93 1:78 1-93 1-80 
39 — 0-68 — 0-87 — 0-53 —0-71 —0-74 — 0-64 —0-71 — 0-49 
40 — 0-88 — 1-08 — 0:57 —0-79 —0-92 — 0-83 — 0-88 — 0-69 
41 —0-14 —0-19 — 0:36 —0-41 — 0-22 —0-13 — 0-23 — 0-08 
42 0:77 0:97 0-24 0-51 0-75 0-72 0-73 0-58 
43 —1-61 — 1-55 — 0:67 — 0-94 —1-51 —1-61 — 1-42 — 1-58 
44 — 0-67 — 0:86 —0-53 -—0-71 —0-73 — 0-63 —0-71 — 0-49 
45 0:58 0-76 0:06 0-27 0-54 0:54 0-51 0-41 
46 — 1-06 — 1-23 — 0-60 — 0:84 — 1-08 —1-01 —1-02 — 0-88 
47 0°51 0:68 0-01 0-19 0-46 0:47 0-44 0:35 
48 — 0-24 — 0-33 — 0-40 — 0-48 — 0-32 — 0-22 —0-33 —0-15 
49 —1-60 — 1-54 — 0-67 — 0-94 —1:50 — 1-60 —1-41 — 1-56 
50 0:29 0:40 —0-14 — 0-05 0:23 0:27 0-20 0-18 
X(z) —7:73 — 7-20 — 0:88 —1-75 — 6-42 — 7:80 — 5-94 — 17:36 

67-1551 | 62-3312 | 41-2024 | 56-4089 | 65-3910 | 67-9222 | 63-2752 | 66-3356 
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Fourth fifty 
x X Xs XM vs X vy Xs 
1 1-05 1-22 0-56 0-92 1:07 1-00 1-05 0:87 
2 0-61 0-79 0-09 0-31 0-57 0°57 0-55 0-43 
3 —0-01 —0-01 — 0-30 —0:31 —0-09 —0-01 —0-11 —0-01 
4 — 0-92 —1-11 — 0-58 — 0-80 — 0-96 — 0-87 —0-91 — 0-73 
5 1-17 1-31 0-73 1-11 1-21 1-13 1-20 1-00 
6 —1-91 — 1-63 — 0-69 — 0-97 — 1-68 — 1-96 — 1-64 — 2-04 
7 — 0-48 — 0-64 — 0-48 — 0-62 — 0°55 — 0:45 — 0-54 — 0-33 
8 —0-21 — 0-29 — 0-39 — 0-46 — 0-29 —0:19 — 0:30 —0-13 
9 —2-47 —1-71 —0-72 —0-99 — 1-85 — 2-64 —2-12 — 3-04 
10 — 0-28 — 0-38 —0-41 —0°51 — 0-36 — 0-26 — 0-36 — 0-18 
ll —0-43 —0-58 — 0-46 — 0-59 — 0-50 —0-40 — 0-50 — 0-29 
12 0-08 0-11 — 0-26 — 0-24 0-01 0-07 — 0-02 0-05 
13 — 0-60 — 0-78 —0-51 — 0-68 — 0-67 —0:56 — 0-65 — 0-42 
14 — 1-60 —1-54 — 0-67 —0-94 — 1-50 — 1-60 —1-41 — 1-56 
15 — 0-98 —1-17 — 0-59 — 0-82 —1-01 — 0-93 — 0-95 —0-79 
16 — 0-62 —0:81 —0-51 — 0-69 — 0:69 — 0:58 — 0-66 — 0-44 
17 1-47 1-49 1-25 1-65 1-57 1-45 1-56 1-38 
18 — 0-60 —0-78 —0-51 — 0-68 — 0-67 — 0-56 — 0-65 — 0-42 
19 0-66 0-85 0-13 0-37 0-63 0-62 0-60 0-48 
20 —0-52 — 0-69 | — 0-49 — 0:64 — 0:59 — 0-48 — 0-58 — 0-36 
21 1-82 161 | 2-09 2:37 2-00 1-85 2-01 1-89 
22 —0:27 — 0-37 —0-41 — 0-50 — 0°35 — 0-25 — 0:36 —0-17 
23 0-59 0:77 0-07 0-28 0°55 0-55 0:52 0-42 
24 0-07 0-10 — 0-27 — 0-25 0-00 0:06 — 0-03 0-04 
25 — 0-25 — 0:34 — 0-40 — 0-49 — 0:33 — 0-23 — 0-34 —0:16 
26 0°75 0-95 0-22 0-48 0:73 0-70 0-70 0-56 
27 0-25 0:34 —0:17 —0-09 0-18 0-23 0-16 0-16 
28 2:24 1-69 3-58 3-38 2-53 2-36 2:57 2-61 
29 — 0:27 — 0-37 —0:41 — 0-50 — 0°35 — 0-25 — 0:36 —0:17 
30 — 0-22 —0:30 — 0-39 —0:47 — 0:30 — 0:20 —0-31 —0-14 
31 0-06 0-08 — 0-27 — 0-26 — 0-02 0-06 — 0-04 0-03 
32 — 0-75 — 0:95 — 0-54 —0°74 —0-81 — 0:70 —0°77 — 0-56 
33 — 2-27 — 1-69 — 0-72 — 0-99 — 1-82 — 2-39 — 1-93 — 2-66 
34 — 0-23 — 0-32 — 0-40 — 0:47 —0:31 —0-21 — 0-32 —0-14 
35 —1-18 — 1-32 — 0-62 — 0-87 —1-18 —1-14 -111 — 1-02 
36 — 0:62 —0-81 —0-51 — 0-69 — 0-69 —0:58 — 0-66 — 0-44 
37 0:47 0-63 —0-02 0-14 0:42 0-44 0-39 0-32 
38 0-92 1-11 0-40 0-72 0-92 0-87 0-90 0:73 
39 — 0-32 — 0-43 — 0-43 — 0:53 — 0-40 — 0-30 — 0-40 — 0-20 
40 — 0-23 —0-32 — 0-40 — 0:47 —0:31 —0-21 — 0-32 —0-14 
41 — 0-89 —1-09 — 0°57 —0:79 — 0:93 — 0:84 — 0:88 —0:70 
42 1:33 1-41 0-99 1:39 1-40 1:30 1-39 1-20 
43 0-33 0:45 —0-12 —0-01 0-27 0:30 0-24 0-21 
44 0-68 0:87 0-15 0-39 0-65 0:64 0-62 0-49 
45 — 0-38 —0-51 — 0:45 —0:57 — 0:46 — 0:35 — 0-46 — 0-25 
46 — 0-89 — 1-09 — 0:57 —0-79 — 0-93 — 0:84 — 0-88 — 0-70 
47 — 0-28 — 0-38 —0-41 —0°51 — 0:36 — 0:26 — 0:36 — 0-28 
48 0-19 0-26 — 0:20 —0:14 0-12 0-17 0-09 0-12 
49 0-84 1-04 0-31 0-61 0-83 0-79 0-81 0:65 
50 — 0-03 — 0:04 —0:31 — 0-33 -0O11 — 0-03 —0:13 — 0-02 
L(x) —513 — 5-37 — 5-59 — 6-28 — 5-41 —511 — 5:70 — 4:85 
= (a?) 44-7007 | 43-2703 | 28-9523 | 39-2082 | 42-8955 | 45-2211 | 43-0940 | 45-6167 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 












































Fifth fifty 
vy X v3 X Xs X, Xz Xs 
1 0-09 0-12 — 0-26 — 0-23 0-02 0-08 —0-01 0-05 
2 —2-54 —1-71 —0-73 —0-99 — 1-86 —2-72 —2-19 —3-19 
3 — 0-22 — 0-30 —0-39 —0-47 — 0-30 — 0-20 —0-31 —0-14 
4 — 0-30 —0-41 — 0-42 — 0-52 — 0-38 — 0-28 —0-38 —0-19 
5 1-22 1-35 0-80 1-20 1-27 1-18 1-26 1-06 
6 — 1-23 — 1-35 — 0-63 — 0-88 — 1-22 —1-19 —1-14 —1-07 
7 —0-12 —0-17 —0-35 — 0-40 — 0-20 —0-11 —0-21 —0-07 
8 —0-19 — 0-26 — 0-38 — 0-45 — 0-27 —0-17 — 0-28 —0-12 
9 — 1-69 —1-57 — 0-68 —0-95 — 1-56 —1-70 —1-47 — 1-69 
10 0-04 0-06 — 0-28 —0-27 — 0-04 0-04 — 0-06 0-02 
ll 1-09 1-25 0-61 0-98 1-12 1-05 1-10 0-91 
12 1-03 1-21 0-53 0-89 1-05 0-98 1-03 0-84 
13 —0-61 —0-79 —0-51 — 0-68 — 9-68 — 0°57 — 0-66 — 0-43 
14 — 0-56 —0-74 — 0-50 — 0-66 — 0-63 — 0-52 —061 | —0-39 
15 0-36 0-49 —0-10 0-02 0-30 0-33 0-27 0-23 
16 0-35 0-47 —0-11 0-01 0-29 0-32 0-26 0-23 
17 0-29 0-40 —0-14 — 0-05 0-23 0-27 0-20 0-18 
18 — 0-59 —0-77 —0-51 — 0-67 — 0-66 — 0-55 — 0-64 —0-42 
19 — 0°57 —0-75 —0-50 — 0-67 — 0-64 —0-53 — 0-62 —0-40 
20 —0-15 —0-21 — 0-36 —0-42 — 0-23 —0-14 — 0-24 —0-09 
21 — 0-67 — 0-86 — 0°53 —0-71 —0-73 — 0-63 -0-71 | —0-49 
22 — 0°87 —1-07 — 0°57 —0-79 — 0-92 — 0-82 —0-87 | —0-68 
23 0-35 0-47 -011 0-01 0-29 0-32 0-26 0-23 
24 0-70 0-89 0-17 0-42 0-67 0-66 0-65 0-51 
25 —0-15 —0-21 — 0-36 — 0-42 — 0-23 —0-14 — 0-24 — 0-09 
26 1-30 1-40 0-93 1:34 1:36 1-27 1-35 1-16 
27 0:75 0-95 0-22 0-48 0-73 0-70 0-70 0-56 
28 1-08 1-25 0-60 0-97 1-10 1-04 1-09 0-90 
29 0-67 0:86 0-14 0-38 0-64. 0-63 0-61 0-49 
30 — 0-56 —0-74 — 0-50 — 0-66 — 0-63 — 0-52 —0-61 — 0-39 
31 —1-10 — 1-26 —0-61 — 0°85 —1-12 — 1-06 — 1-05 — 0-92 
32 0-93 1-12 0-41 0-74 0-93 0-88 0-91 0-74 
33 0:55 0-72 0-04 0-23 0-51 0-51 0:48 0-38 
34 0°59 0:77 0-07 0-28 0-55 0°55 0-52 0-42 
35 — 0-85 — 1-05 —0°57 —0-78 — 0-90 — 0-80 — 0°85 — 0-66 
36 —0-15 —0-21 — 0-36 — 0-42 — 0-23 —0-14 — 0-24 —0-09 
37 0-81 1-01 0-28 0-57 0-79 0-76 0-77 0-62 
38 —1-21 — 1:34 — 0-62 — 0-88 —1-21 —1:17 —1-13 — 1-05 
39 —0:44 — 0-59 — 0:46 — 0-60 —0-51 —0-41 —0°51 — 0-30 
40 — 0-47 — 0-63 —0-47 — 0-62 — 0-54 —0-44 —0-54 — 0-32 
41 0-76 0-96 0-23 0-50 0-74 0-71 0-71 0-57 
42 —0-58 —0-76 — 0:50 — 0-67 — 0-65 — 0-54 — 0-63 —0-41 
43 —0:13 —0-18 — 0-36 —0-41 —0-21 | —0-12 — 0-22 — 0-08 
44 0-17 0-23 —0-21 —0-16 0-10 | O16 0:07 0-10 
45 — 1-65 — 1-56 — 0-67 — 0-95 —1:53 | —1-66 — 1-44 — 1-64 
46 — 0-28 — 0-38 —0-41 —0-51 — 0-36 — 0-26 — 0-36 —0-17 
47 0-32 0:43 —0:13 — 0-02 0-26 0-30 0-23 0-20 
48 —2-10 — 1-67 -0-71 —0-98 | -1-77 —2-19 — 1-78 — 2-35 
49 -0:07 | —0-10 — 0-33 —-0-36 | —0-15 — 0-06 —0-17 — 0-04 
50 0-83 1-03 0-30 0-59 | 0-82 0-78 0-79 0-64 
a | —— 
X(x) | —5-77 — 4-20 —10:00 | —9-49 — 6-59 — 6-12 —6-91 — 6-84 
X(a*) | 37-4683 | 40-9470 | 10-6474 | 21-3559 | 33-6241 | 36-8738 | 33-0399 | 34-6564 
| 
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Sixth fifty 
x a) x3 Xs vs Xs xy Xs 
1 0-83 1-03 0-30 0-59 0-82 0-78 0-79 0-64 
2 1-55 1-52 1-42 1-80 1-67 1-54 1-66 1-49 
3 0-36 0-49 —0-10 0-02 0-30 0-33 0-27 0-23 
4 0-36 0-49 —0-10 0-02 0-30 0-33 0-27 0-23 
5 0-14 0-19 — 0-23 —0-19 0-07 0-13 0-04 0-08 
6 —0-17 — 0-23 — 0-37 —0-43 — 0-25 —0-16 — 0-26 —0-10 
7 —2-21 — 1-68 —0-71 —0-99 —1-81 — 2-32 — 1-87 — 2-55 
8 0-66 0-85 0-13 0-37 0-63 0-62 0-60 0-48 
9 —0-45 — 0-60 —0-47 — 0-60 ~0-52 —0-42 —0-52 — 0-30 
10 1-28 1-38 0-90 1-30 1-34 1-25 1-33 1-14 
1l —0-41 — 0-55 — 0-46 —0-58 —0-49 — 0-38 — 0-48 — 0-27 
12 —1-73 ~1-59 — 0-68 — 0-96 — 1-58 —1-75 — 1-50 — 1-75 
13 —1-01 —119 | —0-59 —0-83 —1:04 | —0-96 — 0-98 — 0-82 
14 — 1-38 —1-44 —0-65 —0-91 —1-34 | —1-85 — 1-25 — 1-26 
15 | —0-36 —~ 0-49 —0-44 —0-55 | —0-44 — 0-33 —0-44 — 0-23 
16 0-31 0-42 | —0-13 —0-03 0-25 0-29 0-22 0-19 
17 —2-79 —1-72 —0-73 — 1-00 —1-86* | —3-02 — 2-48 —3-72 
18 0-14 0-19 — 0-23 —0-19 0-07 0-13 0-04 0-08 
19 — 0-68 —0-87 —0-53 —0-71 —0-74 — 0-64 —0-71 — 0-49 
20 1-13 1-28 0-67 1-05 1-16 1-09 1-15 0-96 
21 — 1-30 —1-40 —0-64 —0-90 — 1-28 —1-27 —1-19 —1-16 
22 — 0-64 —0-83 —0-52 —0-70 —0-70 — 0-60 —0-68 — 0-46 
23 —1-63 — 1-55 — 0-67 — 0-95 — 1-52 — 1-63 —1-43 —1-61 
24 —0-49 — 0-65 —0-48 — 0-63 — 0-56 —0-45 — 0-55 —0-33 
25 — 0-25 — 0-34 —0-40 —0-49 —0-33 — 0-23 —0-34 —0-16 
26 —0-64 —0-83 —0-52 —0-70 —0-70 — 0-60 — 0-68 — 0-46 
27 —0-61 —0-79 —0-51 — 0-68 — 0-68 — 0-57 — 0-66 —0-43 
28 0-24 0-33 —0-17 —0-10 0-17 0-22 0-15 0-15 
29 —1-01 —1-19 —0-59 —0-83 —1-04 — 0-96 —0-98 —0-82 
30 —0-62 —0-81 —0-51 — 0-69 —0-69 | —0-58 — 0-66 —0-44 
31 — 0-23 —0-32 —0-40 | —0-47 —0-31 | —9-21 — 0-32 —0-14 
32 0:42 0-56 -—0-:06 | 0-09 0:36 0-39 0-34 0-28 
33 0-32 0-43 —0-13 — 0-02 0:26 0-30 0-23 0-20 
34 0-41 0-55 —0-07 0-08 0-35 0-38 0-33 0-27 
35 1-67 1-57 1-70 2-05 1-81 1-68 1-81 1-66 
36 —0-19 — 0-26 — 0-38 — 0-45 — 0-27 —0-17 — 0-28 —0-12 
37 0-26 0-36 —0-16 —0-08 0-19 0-24 0-17 0-16 
38 —0-48 — 0-64 —0-48 — 0-62 — 0-55 — 0-45 —0-54 —0°33 
39 0-01 0-01 — 0-30 — 0-30 —0-07 0-01 —0-09 0-01 
40 ~1-61 — 1-55 — 0-67 —0-94 —1-51 —1-61 —1-42 — 1-58 
41 0-14 0-19 — 0-23 ~0-19 0-07 0-13 0-04 0-08 
42 —0-76 — 0-96 — 0-55 —0-75 | —0-82 —0-71 — 0-78 — 0-57 
43 0-30 0-41 —0-14 —0-04 0-24 0-28 0-21 0-19 
44 — 0-54 -0-71 ~ 0-49 — 0-65 —0-61 —0-50 — 0-60 —0-37 
45 — 0-86 — 1-06 —0-57 -0-78 | -0-91 —0-81 — 0-86 — 0-67 
46 — 0-75 ~ 0-95 —0-54 —0-74 —0-81 —0-70 —0-77 — 0-56 
47 0-32 0-43 —0-13 —0-02 0-26 0-30 0-23 0-20 
48 —0-69 —0-88 —0-53 —0-72 —0-75 —0-65 —0-72 —0-50 
) 49 —0-06 —0-08 —0-33 — 0-35 ~0-14 — 0-06 —0-16 —0-03 
50 0-67 0-86 0-14 0-38 0-64 0-63 0-61 0-49 
L(x) |-13-03 |—12-62 |-12-:33 |-14-01 |-13-36 |—13-04 |—13-71 |—13-02 
) L(a*) | 43-2437 | 42-6990 | 15-1983 | 26-6345 | 38-1144 | 43-5442 | 38-7677 | 44-3438 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 






















































































Seventh fifty 

| | | | | 
ry Xs Xz 4 Xs | Xe Iq Lg 

A oaeeeee i Ree. |e eee | 4 a 

| | | 
1 1:35 | 1-43 1-02 1-42 1-42 | 1-32 1-41 1-22 
2 | -o92 | -1-11 — 0-58 | — 0-80 — 0-96 — 0-87 —0-91 —0-73 
3 1-27 | 1-38 0-88 | 1-28 1-33 1-23 1-32 1-12 
4 1-28 | 1-38 0-90 | 1:30 1:34 1-25 1:33 1-14 
5 | —213 — 1-67 —0-70 | —0-98 —178 | —2-22 —1-81 —2-41 
6 | -o38 | -051 — 0-45 | — 0-57 —0-46 | —0-35 — 0-46 — 0-25 
7 | —0-10 —0-14 —0-34 | —0-38 —0-18 | —0-09 —0-20 | —0-06 
8 0-12 | 0-17 —0-24 | —0-21 0-05 | O11 0-02 | 0-07 
9 | 231 | 1-70 3:90 | 3-57 262 | 244 | 267 | 2-74 
10 0-47 | (0-63 —0-02 | 0-14 0-42 | 0-44 | 0:39 | 0-32 
un | o42 | 056 -0-:06 | 009 | 0:36 | 0:39 | 0-34 | 0-28 
12 | -107 | -1-24 — 0-60 —085 | —109 | -103 | —1-02 | —0-89 
13 | 022 | 0-30 -019 | -012 | O15 | 020 | O13 | 0-14 
14 | -133 | -1-41 —0-64 | —0-90 | —130 0 | -1:300 | -1-21 — 1-20 
15 | -224 | —1-69 —0-71 -0:99 | -182 | —2:36 — 1-90 —2-61 
16 | — 0-20 ~027 | —0-38 — 0-45 | —0-28 | —0-18 —0-29 | —0-12 
17 0-20 0-27 | -020 | -013 | O13 | 0-18 0-10 | O12 
ig | 0-09 0-12 —0-26 | —0-23 | 0-02 0-08 —0-01 0-05 
19 | 0-02 0-03 — 0-29 — 0-29 — 0-06 0-02 — 0-08 0-01 
20 | — 0-23 — 0-32 —0-40 —0-47 —0-31 —0-21 —0-32 | —0-14 
21 | —1-07 — 1-24 — 0-60 — 0-85 — 1-09 — 1-03 —1-02 | —0-89 
22 1-43 | 1-47 1-17 1-57 1-52 1-41 1-51 1-33 
23 | 0-22 0-30 —0-19 —0-12 0-15 0-20 0-13 0-14 
24 | —1-24 — 1-36 — 0-63 — 0-89 — 1-23 — 1-20 —1-15 — 1-09 
25 0-91 1:10 | 0-39 0-7 0-91 0-86 0-89 0-72 
26 | — 1-88 — 1-63 — 0-69 —0-97 — 1-67 — 1-92 —1-61 — 1-99 
27 0-08 0-11 — 0-26 — 0-24 0-01 0-07 —0-02 0-05 
23 | 219 1-68 3-37 3-25 2-47 2-30 2-50 2-51 
29 | «0-17 0-23 —0-21 — 0-16 0-10 0-16 0-07 0-10 
30 | -0-61 | —0-79 —0-51 — 0-68 —0-68 | —0-57 — 0-66 — 0-43 
31 | —0-12 —0-17 | —0-35 — 0-40 —0-20 | —0-11 —0-21 —0-07 
32 | 0-70 0:89 | O17 | 0-42 0:67 | 0-66 065 | 0-51 
33 | —1-72 — 1-58 —0-68 | —0-96 —1-58 —1-74 —1-49 | —1-74 
34 | — 1-46 — 1-48 — 0-66 — 0-93 — 1-40 — 1-44 —1:31 | —1-37 
35 | —0-36 — 0-49 — 0-44 —0-55 | —0-44 — 0-33 — 0-44 — 0-23 
36 | —1-39 — 1-45 — 0-65 —0-91 | —1:35 — 1:37 — 1-26 — 1-28 
37 0-01 0-01 — 0-30 — 0-30 —0-07 0-01 — 0-09 0-01 
38 0-52 | 0-69 | 0-02 0-20 0-47 0-48 0-45 0-36 
39 | —0-47 — 0-63 —0-47 — 0-62 — 0-54 — 0-44 — 0-54 — 0-32 
40 | -0-01 —0-01 — 0-30 —0-31 | — 0-09 —0-01 —O11 —0-01 
41 | —0-49 — 0-65 —0-48 —0-63 | —0-56 — 0-45 — 0-55 — 0-33 
42 0-19 0-26 — 0-20 —0-14 0-12 0-17 0-09 0-12 
43 | —0-05 — 0-07 —0:32 | —0-35 —013 | —0-05 — 0-15 — 0-03 
44 1-07 1-24 0-59 0-95 109 | 1-03 1-08 0-89 
45 | —1-30 — 1-45 — 0°65 —0-91 —1:35 | —1:37 — 1-26 — 1-28 
46 | 0-96 1-15 0-45 0-78 0-97 0-91 0-95 0-77 
47 | 1-32 1-41 0-97 1:37 1-39 1-29 1-38 1-19 
48 | —0-98 —1-17 — 0-59 — 0-82 —1-01 —0-93 | —0-95 —0-79 
49 | —0-25 — 0-34 — 0-40 —0-49 — 0-33 — 0-23 — 0-34 —0-16 
50 | — 1-20 — 1-33 — 0-62 — 0-88 -120 | -1-16 —1-12 — 1-54 

g aes eee ee Seine Se: eoewen Wn EEE 
L(x) | —5-77 — 5-69 —2-43 | —3-43 — 5-45 — 5-75 — 5-08 — 6-05 
55-4525 | 52-9583 | 40-6117 | 50-1883 | 55-0049 | 55-9079 | 53-1864 | 56-6803 















TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 























































































Eighth fifty 

vy Xe vs vs vs X vy Xs 

1 1-01 1-19 0-51 0-86 1-02 0-96 1:00 0-82 
2 — 0-20 — 0:27 — 0:38 — 0-45 — 0-28 —0-18 — 0-29 —0-12 
3 0:45 0-60 — 0:04 0-12 0-40 0-42 0-37 0°30 
4 — 0-69 — 0:88 — 0:53 — 0-72 —0°75 — 0-65 — 0-72 — 0-50 
5 — 0-76 — 0-96 — 0-55 — 0°75 — 0-82 —0-71 — 0-78 — 0°57 
6 — 0-03 — 0-04 —0:31 — 0:33 —011 — 0-03 —0-13 — 0-02 
7 0:40 0-54 —0-07 0-07 0:34 0:37 0-32 0-26 
8 0-39 0-53 — 0-08 0-05 0:33 0:36 0-30 0-25 
9 1-39 1-45 1-09 1-50 1-47 1:37 1:46 1-28 
10 0°77 0-97 0-24 0°51 0°75 0-72 0-73 0-58 
ll — 0:37 — 0-50 —0:44 | —0-56 — 0-45 — 0-34 — 0:45 — 0-24 
12 0-35 0-47 —011 | 0-01 0-29 0-32 0-26 0-23 
13 — 1-25 —1-37 — 0-63 —0:89 — 1-24 —1-21 —1-16 —1-10 
14 —0:70 — 0-89 — 0-53 —0-72 —0-76 | —0-66 — 0-73 —@-51 
15 1-41 1-46 1-13 1-53 150 | 1:39 1-49 1:30 
16 — 0:04 — 0:06 — 0-32 — 0-34 —0-12 | —0-04 —0-14 — 0-02 
17 0:42 0:56 — 0-06 0-09 0-36 0:39 0-34 0-28 
18 —0-09 —0-12 — 0-34 — 0-38 —0:17 — 0-08 —0-19 — 0-05 
19 — 0:59 —0°77 —0:51 | —0-67 — 0-66 — 0-55 — 0-64 — 0-42 
20 0:77 0-97 0-24 | 0-51 0°75 0-72 0-73 0-58 
21 — 0°69 — 0-88 — 0°53 —0-72 — 0°75 — 0:65 —0-72 — 0-50 
22 0:14 0-19 — 0:23 —0-19 0-07 0-13 0-04 0-08 
23 — 0:34 — 0:46 — 0:43 — 0°54 — 0-42 —0-31 — 0-42 — 0-22 
24 —0°51 — 0-68 — 06-49 — 0:64 — 0:58 — 0:47 — 0:57 — 0-35 
25 0-54 0-71 0-03 0-22 0-49 0-50 0-47 0-37 
26 1-35 1:43 1-02 1-42 1-42 1-32 1-41 1-22 
27 0-06 0-08 — 0-27 — 0-26 — 0-02 0:06 — 0-04 0-03 
28 0:66 0-85 0-13 0:37 0-63 0-62 0-60 0-48 
29 — 0:35 — 0:47 — 0-44 — 0-55 — 0-43 — 0-32 — 0-43 — 0-23 
30 — 0°53 — 0-70 — 0-49 — 0:65 — 0-60 — 0-49 — 0-59 — 0:37 
31 — 0:56 —0:74 — 0-50 | — 0-66 — 0:63 — 0-52 —0-61 — 0:39 
32 — 0-02 — 0-03 —0-31 — 0-32 —0-10 — 0-02 —0-12 —0-01 
33 0:66 0:85 0-13 0:37 0-63 0-62 0-60 0:48 
34 0-10 0-14 — 0-25 — 0-22 0-03 0-09 0-00 0-06 
35 0-52 0-69 0-02 0-20 0-47 0-48 0-45 0:36 
36 — 0:46 —0-61 — 0:47 —0-61 — 0:53 — 0:43 — 0-53 —0:31 
37 0:47 0:63 — 0-02 0-14 0-42 0:44 0-39 0-32 
38 0-40 0-54 — 0:07 0-07 0-34 0-37 0-32 0:26 
39 —1-15 — 1-30 —0:62 | —0-87 —1-16 -1-11 — 1-08 — 0-98 
40 — 0-29 — 0-40 — 0-42 —0-51 —0-37 | —0-27 — 0:37 —0-18 
41 0-82 1-02 0:29 0-58 0-81 | O77 0-78 0-63 
42 0-23 0-32 —0-18 -—0-11 0-16 0-21 0-14 0-14 
43 — 0-87 — 1-07 — 0:57 —0-79 — 0-92 — 0-82 — 0:87 — 0-68 
44 —0-12 —0:17 — 0-35 — 0-40 — 0:20 -—0-11 —0-21 — 0-07 
45 0:64 0:83 0-11 0:34 0-60 0-60 0:58 0-46 
46 — 0:03 — 0-04 —0:31 — 0-33 -—0O11 — 0-03 —0:13 —0:02 
47 | 0-17 0-23 —0-21 —0-16 0-10 0-16 0-07 0-10 
48 | 1-49 1-50 1-29 1-69 1:59 1-48 1-59 1-41 
49 —0-51 — 0-68 — 0-49 — 0-64 — 0-58 — 0:47 — 0°57 — 0°35 
50 0-62 0-81 0-10 0-32 0-58 0-58 0:56 0-44 
x(a) 5-08 5:47 — 6-22 —4-01 2-79 4-98 2-51 4-51 

22-2392 | 30-8785 | 11-2092 | 20-7837 | 23-8075 | 20-3996 | 22-5705 






















TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 


























Ninth fifty 
% % Xs % vs % 2% ad) 
= - 
j 1 | —0-54 —0-71 — 0-49 — 0-65 —0-61 — 0-50 — 0-60 —0-37 
2 1-11 1-27 0-64 1-01 1-14 1-07 1-12 0-94 
3 0-59 0-77 0-07 0-28 0-55 0-55 0-52 0-42 
| 4 | —1-64 — 1-56 — 0-67 — 0-95 —1-53 — 1-64 — 1-44 — 1-62 
5 0-24 0-33 —0-17 -- 0-10 0-17 0-22 0-15 0-15 
| 6 | —1-65 — 1-56 — 0-67 — 0-95 —1-53 — 1-66 —1-44 — 1-64 
| 7 | —0-83 — 1-03 — 0-56 —0-77 — 0-88 — 0-78 — 0-84 — 0-64 
| ; 8 1-06 1-23 0-57 0-93 1-08 1-01 1-06 0-88 
| 9 | —0-17 — 0-23 — 0-37 — 0-43 — 0-25 —0-16 — 0-26 —0-10 
| 10 | —1-31 — 1-40 — 0-64 — 0-90 —1-29 — 1-28 — 1-20 —1-17 
11 | —0-56 —0-74 — 0-50 — 0-66 — 0-63 — 0-52 —0-61 — 0-39 
12 0-66 0-85 0-13 0-37 0-63 0-62 0-60 0-48 
| 13 1-43 1-47 1-17 1-57 1-52 1-41 1-51 1-33 
| 14 | —0-18 — 0-25 — 0-38 — 0-44 — 0-26 —0-17 —0-27 —0-11 
) } 15 | —0-07 —0-10 — 0-33 — 0:36 —0-15 — 0-06 —0-17 — 0-04 
; 16 | —0-41 | -0-55 | -0-46 | -058 | -049 | -0-38 | -0-48 | —0-27 
17 0-51 0-68 0-01 0-19 0-46 0-47 0-44 0-35 
18 0-97 1-16 0-46 0-80 0-98 0-92 0-96 0-78 
19 | —1-20 — 1-33 — 0-62 — 0-88 — 1-20 —1-16 —1-12 — 1-54 
20 | —0-10 —0-14 — 0-34 — 0-38 —0-18 — 0-09 — 0-20 — 0-06 
) } 21 1-53 1-51 1-37 1-76 1-64 1-52 1-64 1-46 
; 22 | —0-68 — 0-87 — 0-53 —0-71 — 0-74 — 0-64 —0-71 —0-49 
) 23 1-70 1-58 1-77 2-11 1-85 1-71 1-85 1-71 
; 24 1-40 1-45 1-11 1-52 1-48 1-38 1-48 1-29 
; 25 0-17 0-23 —0-21 — 0-16 0-10 0-16 0-07 0-10 
) 26 | —1-98 — 1-65 —0-70 — 0-98 —1-72 — 2-04 — 1-49 — 2-15 
3 27 | —0-61 —0-79 —0-51 — 0-68 — 0-68 — 0-57 — 0-66 —0-43 
' } 28 1-03 1-21 0-53 0-89 1-05 0-98 1-03 0-84 
3 29 0-66 0-85 0-13 0-37 0-63 0-62 0-60 0-48 
7 30 | —0-62 —0-81 —0-51 — 0-69 — 0-69 — 0-58 — 0-66 —0-44 
9 31 | —0-03 — 0-04 —0-31 — 0-33 —0-11 — 0-03 —0-13 — 0-02 
1 32 0-15 0-21 — 0-23 —0-18 0-08 0-14 0-05 0-09 
g 33 | —1-86 — 1-62 — 0-69 —0-97 — 1-66 — 1-90 — 1-60 — 1-96 
6 34 | —1-55 — 1-52 — 0-66 — 0-94 — 1-46 — 1-54 — 1-37 —1-49 
6 35 0-34 0-46 —0-11 0-00 0-28 0-31 0-25 0-22 
1 ; | 36 | —0-63 — 0-82 — 0-52 — 0-69 — 0-69 — 0-59 — 0-67 — 0-45 
9 37 0-30 0-41 —0-14 — 0-04 0-24 0-28 0-21 0-19 
6 38 0-31 0-42 —0-13 — 0-03 0-25 0-29 0-22 0-19 
8 | 39 1-13 1-28 0-67 1-05 1-16 1-09 115 | 0-96 
8 40 0-68 0-87 0-15 0-39 0-65 0-64 0-62 0-49 
3 41 | —0-01 —0-01 — 0-30 —0-31 — 0-09 —0-01 —O11 —0-01 
4 42 | —0-45 — 0-60 —0-47 — 0-60 — 0-52 — 0-42 —0-52 —0-30 
8 } 43 0-03 0-04 — 0-29 — 0-28 — 0-05 0-03 —0-07 0-02 
7 44 0-03 0-04 — 0-29 — 0-28 — 0-05 0-03 —0-07 0-02 
6 45 | —0-64 — 0-83 — 0-52 —0-70 —0-70 — 0-60 — 0-68 — 0-46 
2 | 46 0-34 0-46 —O11 0-00 0-28 0-31 0-25 0-22 
0 | 47 0-01 0-01 — 0-30 —0-30 —0-07 0-01 —0-09 0-01 
1 | 48 0-49 0-65 —0-01 0-16 0-44 0-45 0-41 0-33 
5 | 49 | —0-63 — 0-82 — 0-52 — 0-69 — 0-69 — 0-59 — 0-67 — 0-45 d 
4 r | 50 | —207 — 1-67 —0-70 — 0-98 — 1-76 — 2-15 — 1-76 — 2-30 
1 L(x) | —3-55 —2-21 — 6-18 —5-19 — 4-02 — 3-84 — 3-90 — 4-95 
I 47-3053 | 16-9168 | 30-6523 | 42-6600 | 43-4802 | 40-4120! 40-8547 
















































TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 














































































Tenth fifty 
| 

x Xo | vs v vs X, x Xs 

1 0-28 0-38 —0-15 — 0-06 0-21 0-26 0-19 0-17 

2 —1-52 —1-51 — 0-66 — 0-93 — 1-44 —1-51 — 1-35 — 1-45 

3 1-52 1-51 1-35 1-74 1-63 1-51 1-63 1-45 

4 0-42 0-56 — 0-06 0-09 0-36 0-39 0-34 0-28 

5 — 1-07 — 1-24 — 0-60 — 0°85 — 1-09 — 1-03 — 1-02 — 0-89 

6 — 0-35 — 0-47 — 0-44 — 0-55 — 0-43 — 0-32 — 0-43 — 0-23 

7 —0-37 —0-50 — 0-44 — 0-56 — 0-45 — 0-34 —0-45 — 0-24 

8 — 0-38 —0-51 — 0-45 — 0°57 — 0-46 — 0-35 — 0-46 — 0-25 

9 0-09 0-12 — 0-26 — 0-23 0-02 0-08 —0-01 0-05 

10 — 0-38 —0-51 — 0-45 — 0-57 — 0-46 — 0-35 — 0-46 0-25 
ll 0-38 0-51 —0-09 0-04 0-32 0-35 0-29 0-25 
12 0-88 1-08 0-35 0-66 0:87 0-83 0-85 0-69 
13 — 1-92 — 1-64 — 0-69 —0-97 — 1-69 — 1-97 — 1-64 — 2-05 
14 1-11 1-27 0-64 1-01 1-14 1-07 1-12 0-94 
15 — 1-59 — 1-54 — 0-67 —0-94 — 1-49 — 1-59 —1-40 — 1-55 
16 — 0-33 —0-45 — 0-43 — 0-54 —0-41 — 0-30 —0-41 —0-21 
17 — 0-63 — 0-82 — 0-52 — 0-69 —0-69 —0-59 — 0-67 —045 
18 0-96 1-15 0-45 0-78 0-97 0-91 0-95 0-77 
19 1-05 1-22 0-56 0-92 1-07 1-00 1-05 0-87 
20 — 0-48 —0-64 | —0-48 — 0-62 — 0-55 — 0-45 — 0-54 — 0-33 
21 — 0-60 -0-78 | —0-51 — 0-68 — 0-67 — 0-56 — 0°65 — 0-42 
22 0-69 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
23 — 0-46 —0-61 — 0-47 —0-61 —0-53 —0-43 —0-53 —0-31 
24 — 0-87 —1-07 — 0°57 —0-79 — 0-92 — 0-82 — 0-87 — 0-68 
25 — 0-45 —0-60 —0-47 — 0-60 —0-52 —0-42 — 0-52 — 0-30 
26 —0-14 —0-19 — 0-36 —0-41 —0-22 —0-13 — 0-23 — 0-08 
27 —1-02 — 1-20 — 0-60 —0-83 — 1-05 —0-97 —0-99 — 0-83 
28 — 0-58 -0-76 | —0-50 — 0-67 — 0-65 — 0-54 — 0-63 —0-41 
29 1-38 1-44 1-08 1-48 1-46 1-35 1-45 1-26 
30 lll 1-27 0-64 1-01 1-14 1-07 1-12 0-94 
31 —1-49 — 1-50 — 0-66 —0-93 — 1-42 — 1-48 — 1-33 —1-41 
32 —0-14 -0-19 | —0-36 —0-41 — 0-22 —0-13 — 0-23 — 0-08 
33 0-50 0-66 0-00 0-18 0-45 0-46 0-42 0-34 
34 — 0-35 — 0-47 —0-44 — 0-55 — 0-43 — 0-32 —0-43 — 0-23 
35 0-94 1-13 0-42 0-75 0-94 0-89 0-92 0-75 
36 0-50 0-66 | 0-00 0-18 0-45 0-46 0-42 0-34 
37 0-83 1-03 0:30 0-59 0-82 0-78 0-79 0-64 
38 0-04 0:06 — 0-28 — 0-27 — 0-04 0-04 — 0-06 0-02 
39 —0-12 —017 — 0°35 —0-40 — 0-20 —0-11 —0-21 —0-07 
40 0-30 0-41 —0-14 — 0-04 0-24 0-28 0-21 0-19 
41 — 1-45 — 1-48 — 0-65 —0-92 —1-39 — 1-43 — 1-30 — 1-36 
42 — 0-23 — 0-32 — 0-40 — 0-47 —0-31 —0-21 — 0-32 —0-14 
43 0-77 0-97 0-24 0-51 0-75 0-72 0-73 0-58 
44 — 0-37 —0-50 —0-44 — 0-56 — 0-45 —0-34 — 0-45 — 0-24 
45 1-26 1-37 0-87 1-27 1-32 1-22 1-30 1-11 
46 —0-62 —0-81 —0-51 — 0-69 — 0-69 — 0-58 — 0-66 — 0-44 
47 0-00 0-00 — 0-30 —0-31 — 0-08 0-00 —0-10 0-00 
48 0-83 1-03 0-30 0-59 0-82 0-78 0-79 0-64 
49 0-88 1-08 0-35 0-66 0-87 0-83 0-85 0-69 
50 1-21 1-34 0-79 1-18 1-26 1-17 1-24 1-05 
X(zx) 0-02 0-65 — 5-90 —4:17 —1-18 —0:17 — 1-06 0-12 

13-5620 | 26-8849 | 36-8026 | 34-5703 | 34-4902 | 28-4536 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 
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Eleventh fifty 
ae Xs vs v vs i] vs 
1 0-88 1-08 0-35 0-66 0-87 0-85 0-69 
2 — 0-62 —0-81 —0-51 — 0-69 — 0-69 — 0-66 — 0-44 
3 — 0-36 — 0-49 — 0:44 — 0-55 — 0-44 — 0-44 — 0-23 
4 0-86 1-06 0-33 0-64 0-85 0-83 0-67 
5 0-98 1-17 0-47 0-81 0-99 0-97 0-79 
6 —0:°73 — 0-93 — 0-54 —0-74 —0-79 — 0-76 — 0-54 
7 — 0-52 — 0-69 — 0-49 — 0°64 — 0-59 — 0-58 — 0-36 
8 — 0-72 — 0-92 — 0-54 —0-73 —0-78 —0-75 — 0-53 
9 — 0-97 —1-16 — 0-59 — 0-82 — 1-00 — 0-95 —0-78 
10 1-28 1-38 0-90 1:30 1-34 1-33 1-14 
—0-18 — 0°25 — 0-38 — 0°44 — 0°26 — 0-27 —0-11 
— 0:27 — 0°37 — 0-41 — 0-50 — 0°35 — 0-36 —0-17 
1-17 1-31 0-73 1-12 1-21 1-20 1-00 
0-91 1-10 0-39 0-71 0-91 0-89 0-72 
0-15 0-21 — 0-23 —0-18 0-08 0-05 0-09 
0-72 0-92 0-19 0-44 0-69 0-67 0-53 
— 1-25 — 1-37 — 0-63 —0-°89 — 1-24 —1-16 —1-10 
— 1-08 — 1-25 — 0-61 — 0-85 —1-10 — 1-03 — 0-90 
—1-18 — 1-32 — 0-62 — 0-87 —1-18 —1-11 — 1-02 
— 0-89 — 1-09 — 0°57 — 0-79 — 0-93 — 0-88 — 0-70 
0-30 0-41 —0-14 — 0:04 0-24 0-21 0-19 
— 0°65 — 0-84 — 0-52 — 0-70 —0-71 — 0-69 — 0-47 
0-88 1-08 0-35 0-66 0-87 0-85 0-69 
0-98 1-17 0-47 0-81 0-99 0-97 0-79 
1-97 1-65 2-56 2-71 2-19 2-20 2-14 
— 0-82 — 1-02 — 0-56 —0°77 — 0°87 — 0°83 — 0-63 
0-60 0:78 0-08 0-29 0-56 0-53 0-42 
— 0-37 — 0-50 — 0-44 — 0°56 — 0°45 — 0-45 — 0°24 
0-68 0:87 0°15 0°39 0-65 0-62 0-49 
— 0°88 — 1-08 — 0:57 —0-°79 — 0-92 — 0-88 — 0-69 
1-73 1-59 1-85 2°17 1-89 1-89 1-75 
0-38 0-51 — 0-09 0-04 0-32 0-29 0:25 
— 0-65 — 0°84 — 0-52 — 0-70 —0-71 — 0-69 — 0°47 
1-07 1-24 0-59 0-95 1-09 1-08 0-89 
— 0-05 — 0:07 — 0-32 — 0-35 —0-13 —0°15 — 0-03 
— 0°54 —0-71 — 0-49 — 0°65 — 0-61 — 0-60 — 0-37 
— 0-28 — 0:38 —0-41 —0-51 — 0-36 — 0:36 —0:17 
— 0-61 —0-79 —0-51 — 0-68 — 0-68 — 0-66 — 0-43 
— 0-22 — 0-30 — 0:39 — 0:47 — 0-30 —0:31 —0-14 
0-15 0-21 — 0-23 —0-18 0-08 0:05 0-09 
— 0°86 — 1-06 — 0-57 — 0-78 —0-91 — 0-86 — 0-67 
0:75 0:95 0-22 0:48 0:73 0:70 0-56 
0-82 1-02 0-29 0-58 0-81 0-78 0-63 
— 0-73 — 0-93 — 0°54 — 0-74 — 0-79 — 0-76 — 0-54 
0-40 0-54 — 0-07 0-07 0:34 0:32 0:26 
0-17 0-23 —0-21 —0-16 0-10 0-07 0-10 
1-36 1-43 1-04 1-44 1-44 1-43 1-24 
— 0-98 —1-17 — 0-59 — 0-82 —1-01 — 0-95 —0-79 
— 1-30 — 1-40 — 0°64 — 0-90 — 1-28 —1-19 —1-16 
0:06 0-08 — 0-27 — 0-26 — 0-02 — 0-04 0-03 
1-54 0-25 — 3-68 — 2-49 0-14 0-41 2-47 
35-9004 46-4311 21-2352 35-1287 39-0552 37-0161 26-6425 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 

















Twelfth fifty 
' — 
at X v3 v% vs X dd Xs 
1 —1-01 —1-19 — 0°59 — 0°83 —1-04 — 0:96 — 0-98 — 0-82 
2 — 0-43 — 0°58 — 0-46 — 0-59 — 0-50 — 0-40 — 0-50 — 0-29 
3 —0°7 — 0:96 — 0-55 —0-75 — 0-82 —0-71 —0-78 — 0-57 
4 0-13 0-18 — 0-24 — 0-20 0-06 0-12 0-03 0-08 
5 —0-87 — 1-07 — 0-57 —0-79 — 0-92 — 0-82 — 0-87 — 0-68 
6 1-69 1-57 1-74 2-09 1-84 1-70 1-84 1-69 
7 0-02 0-03 — 0-29 — 0-29 — 0-06 0-02 — 0-08 0-01 
8 0-33 0-45 —0-12 —0-01 0:27 0-30 0:24 0-21 
9 —0-79 — 0-99 — 0°55 — 0-76 — 0:84 —0:°74 — 0:80 — 0-60 
10 1-41 1-46 1-13 1-53 1-50 1-39 1-49 1-30 
11 1-79 1-60 2-01 2-30 1-96 1-82 1:97 1:85 
12 1-38 1-44 1-08 1-48 1-46 1-35 1-45 1-26 
13 0-71 0-90 0-18 0-43 0-68 0-66 0:66 0-52 
14 — 0-28 — 0-38 —0-41 —0-°51 — 0-36 — 0-26 — 0-36 —0°17 
15 — 0-96 —1:15 — 0-59 — 0-82 — 0-99 —0-91 — 0-94 —0-°77 
16 — 0-09 —0-12 — 0-34 — 0-38 —0-17 — 0-08 —0-19 — 0-05 
17 — 0-60 —0-78 —0-51 — 0-68 — 0-67 — 0-56 — 0-65 — 0-42 
18 — 0-09 —0-12 — 0°34 — 0°38 —0°17 — 0-08 —0-19 — 0-05 
19 —0-51 — 0-68 — 0-49 — 0-64 — 0-58 — 0°47 — 0-57 — 0-35 
20 — 0-29 — 0-40 — 0-42 —0-51 — 0°37 — 0-27 — 0:37 —0-18 
21 1-50 1-50 1-31 1-71 1-61 1-49 1-60 1-42 
22 — 0-47 — 0-63 — 0-47 — 0-62 — 0°54 — 0:44 — 0°54 — 0-32 
23 — 2°34 —1-70 — 0-72 — 0-99 —1-84 — 2-48 —1-99 — 2-80 
24 — 1-09 — 1-25 — 0-61 — 0°85 -—1-11 — 1-05 — 1-04 —0-91 
25 1-18 1-32 0-74 1-13 1-22 1-14 1-21 1-02 
26 — 0-53 — 0-70 — 0-49 — 0-65 — 0-60 — 0-49 — 0°59 — 0:37 
27 —0°73 — 0-93 — 0°54 — 0°74 —0-79 — 0:68 — 0-76 — 0-54 
28 1-47 1-49 1-25 1-65 1-57 1-45 1-56 1-38 
29 —0-78 — 0-98 — 0°55 — 0°75 — 0-83 —0-°73 — 0:80 — 0-59 
30 — 0°30 —0-41 — 0-42 — 0-52 — 0°38 — 0-28 — 0°38 —0-19 
31 1-73 1-59 1-85 2-17 1-89 1-75 1-89 1-75 
32 1-02 1-20 0-52 0:87 1-03 0:97 1-02 0-83 
33 —0-31 — 0-42 — 0-42 — 0-52 — 0°39 — 0-29 — 0-39 —0-19 
3t 1-28 1-38 0-90 1-30 1:34 1-25 1-33 1-14 | 
35 —1-14 — 1-29 — 0-61 — 0:86 —1-15 —1-10 — 1-08 — 0-97 
36 —0-27 — 0-37 —0-41 — 0-50 — 0°35 — 0-25 — 0-36 —0-17 
37 —1-14 — 1-29 —0-61 — 0-86 —1-15 —1-10 — 1-08 — 0-97 
38 1-68 1-57 1-72 2-07 1-83 1-69 1-83 1-68 
39 —1-70 — 1-58 — 0-68 — 0°95 — 1-56 —1-71 —1-48 —1-71 
40 0-27 0-37 —0-16 — 0-07 0-20 0-25 0-18 0-17 ' 
41 0-69 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
42 — 0°85 — 1-05 — 0°57 — 0-78 — 0-90 — 0-80 — 0°85 — 0:66 
43 0-50 0-66 0-0C 0-18 0:45 0:46 0-42 0-34 
44 — 0-05 — 0-07 — 0°32 — 0°35 —0-13 — 0:05 —0°15 — 0-03 
45 —0-15 —0-21 — 0°36 — 0-42 — 0-23 —0°14 — 0-24 — 0-09 
46 1-66 1-56 1-67 2-03 1-80 1-67 1-80 1-65 
47 0-76 0-96 0-23 0-50 0-74 0-71 0-71 0-57 ‘ 
48 —1-38 — 1-44 — 0°65 —0-91 — 1-34 — 1-35 — 1-25 — 1-26 
49 0-53 0-70 0-02 0-21 0-48 0-49 0:46 0:37 
50 — 0-87 — 1-07 — 0°57 —0-°79 — 0-92 — 0-82 — 0:87 — 0-68 
x(x) 0-95 — 1-00 0-88 1-79 0-89 1-31 1-19 2-34 
x(x?) 51-6413 55-3842 31-7714 51-7893 54-4177 50-5009 52-9947 46-1012 


















































TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 












































Thirteenth fifty 
Ms x Xo Xs %, Xs X Ly Xs 
82 1 0-30 0-41 ~0-14 —0-04 0-24 0-28 0-21 0-19 
29 2 0-95 1-14 0-43 0-77 0-95 0-90 0-93 0-76 
‘57 3 —1-00 —1-18 — 0-59 —0-83 —1-03 — 0-95 —0-97 —0-81 
08 4 1-43 1-47 1-17 1-57 1-52 1-41 1-51 1-33 
68 5 1-06 1-23 0-57 0-93 1-08 1-01 1-06 0-88 
69 6 | —0-66 —0-85 ~ 0-52 -0-71 ~ 0-72 — 0-62 —0-70 —0-48 
01 7 0-60 0-78 0-08 0-29 0-56 0-56 0-53 0-42 
21 8 1-11 1-27 0-64 1-01 1-14 1-07 1-12 0-93 
60 9 | —0-08 -0-11 — 0-34 —0-37 —0-16 —0-07 —0-18 — 0-05 
30 10 1-41 1-46 1-13 1-53 1-50 1-39 1-49 1-30 
85 ll 0-78 0-98 0-25 0-52 0-76 0-73 0-74 0-59 
26 12 | -201 — 1-66 —0-70 — 0-98 —1-73 — 2-08 —1-71 — 2-20 
‘52 13 —1-53 —1-51 — 0-66 —0-93 — 1-45 —1-52 — 1-36 — 1-46 
17 14 0-30 0-41 ~0-14 —0-04 0-24 0-28 0-21 0-19 
‘17 15 0-87 1-07 0-34 0-65 0-86 0-82 0-84 0-68 
05 16 | —0-77 —0-97 —0-55 —0-75 — 0-82 —0-72 —0-79 — 0-58 
42 17 2-32 1-70 3-94 3-59 2-63 2-46 2-68 2-75 
05 18 0-62 0-81 0-10 0-32 0-58 0-58 0-56 0-44 
35 19 | —0-93 —1-12 — 0-58 —0-81 —0-97 — 0-88 —0-92 —0-74 
18 20 1-65 1-56 1-65 2-01 1-79 1-66 1-79 1-64 
42 21 0-13 0-18 —0-24 —0-20 0-06 0-12 0-03 0-08 
32 22 1-35 1-43 1-02 1-42 1-42 1-32 1-41 1-22 
80 233 | -1-14 — 1-29 —0-61 — 0-86 —1-15 —1-10 — 1-08 —0-97 
‘91 24 0-35 0-47 ~0-11 0-01 0-29 0-32 0-26 0-23 
02 25 | —215 — 1-68 —0-71 — 0-98 —1-79 — 2-25 — 1-83 — 2-44 
37 26 0-43 0-58 —0-05 0-10 0-37 0-40 0-35 0-29 
‘54 27 —1-41 — 1-46 — 0-65 — 0-92 — 1-36 — 1-39 — 1-27 — 1-30 
38 28 | —0-14 —0-19 — 0-36 —0-41 — 0-22 —0-13 — 0-23 —0-08 
59 29 1-69 1-57 1-74 2-09 1-84 1-70 1-84 1-69 
19 30 0-84 1-04 0-31 0-61 0-83 0-79 0-81 0-65 
‘75 31 | —2-14 ~ 1-68 —0-71 —0-98 —1-79 — 2-24 — 1-82 — 2-43 
83 32 —0-75 — 0-95 —0-54 —0-74 —0-81 —0-70 —0-77 — 0-56 
19 : 33. | —0-58 —0-76 — 0-50 — 0-67 — 0-65 —0-54 — 0-63 —0-41 
‘14 | 34 — 0-25 —0-34 —0-40 —0-49 —0-33 — 0-23 — 0-34 —0-16 
97 35 0-29 0-40 —0-14 — 0-05 0-23 0-27 0-20 0-18 
17 % | -100 —1-18 —0-59 — 0-83 —1-03 — 0-95 —0-97 —0-81 
97 37 | -169 =| -1-57 | -068 | -0-95 | -1-56 | -1-70 | -1-47 | —1-69 
68 38 0-63 0-82 0-11 0-33 0-59 0-59 0-57 0-45 
71 39 — 1-34 —1-42 — 0-64 —0-91 ~1-31 —1-31 — 1-22 —1-21 
17 } 40 | -1-7 ~1-60 — 0-68 — 0-96 —1-60 —1-78 — 1-52 —1-80 
50 41 0-73 0-93 0-20 0-46 0-70 0-68 0-68 0-54 
66 42 —0-10 —0-14 — 0-34 — 0-38 —0-18 —0-09 — 0-20 — 0-06 
34 43 0-69 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
03 44 0-63 0-82 0-11 0-33 0-59 0-59 0-57 0-45 
‘09 45 — 1-33 —1-41 — 0-64 —0-90 — 1-30 — 1-30 —1-21 — 1-20 
65 ' 46 —0-63 — 0-82 — 0-52 — 0-69 — 0-69 — 0-59 — 0:67 — 0-45 
57 47 0-11 0-15 —~ 0-25 — 0-22 0-04 0-10 0-01 0-06 
26 48 — 1-08 — 1-25 —0-61 — 0-85 —1-10 —1-04 ~ 1-03 — 0-90 
37 49 1-05 1-22 0-56 0-92 1-07 1-00 1-05 0-87 
‘68 | 50 0-48 0-64 — 0-02 0-15 0:43 0:45 0-40 0:33 
soda | 
34 Xz) | —1-67 0:28 0-30 1-57 -o-78 | —-205 | —0-41 ~3-15 
1012 | U(z*) | 61-4693 | 62-0998 | 34-5500 | 48-1979 | 59-7628 | 61-2141 | 57-3189 | 58-3595 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 








































































Fourteenth fifty 
vy X | v3 | v4 vs % i] Xs 
1 0-84 1-04 0-31 0-61 0-83 0-79 0-81 0-65 
2 0-77 0-97 0-24 0-51 0-75 0-72 0-73 0-58 
3 0-78 0-98 0:25 0-52 0-76 0-73 0:74 0-59 
4 1-78 1-60 1-98 2-28 1-95 1-81 1-96 1-83 
5 — 0-40 — 0-54 — 0-45 — 0-58 — 0-48 — 0°37 — 0-47 — 0-26 
6 0-08 0-11 — 0-26 — 0-24 0-01 0:07 — 0-02 0-05 
7 —0-01 —0-01 — 0-30 — 0-31 — 0-09 —0-01 —0-11 —0-01 
8 —0-14 —0-19 — 0-36 —0-41 — 0-22 —0-13 — 0:23 — 0-08 
9 0-11 0-15 — 0-25 — 0-22 0-04 0-10 0-01 0-06 
10 0-19 0-26 — 0-20 —0-14 0-12 0-17 0-09 0-12 
ll — 0-09 —0-12 — 0-34 — 0-38 —0-17 — 0-08 —0-19 — 0-05 
12 — 0-40 — 0-54 — 0-45 — 0-58 — 0-48 — 0°37 — 0-47 — 0-26 
13 0-46 0-61 — 0-03 0-13 0-41 0-43 0-38 0-31 
14 0:07 0-10 — 0-27 — 0-25 0-00 0-06 — 0-03 0-04 
15 — 1-95 — 1-64 — 0-70 — 0-97 — 1-70 — 2-01 — 1-67 — 2-10 
16 — 1-09 — 1-25 —0-61 — 0-85 -—1-11 —1-05 — 1-04 —0-91 
17 1-54 1-52 1-40 1-79 1-65 1-53 1-65 1-48 
18 0-45 0-60 — 0-04 0-12 0-40 0-42 0-37 0-30 
19 — 0-61 — 0-79 —0-51 — 0-68 — 0-68 — 0-57 — 0-66 — 0-43 
20 — 0-53 — 0-70 — 0-49 — 0-65 — 0-60 — 0-49 — 0-59 — 0-37 
21 0-54 0-71 0-03 0-22 0-49 0-50 0:47 0-37 
22 1-49 1-50 1-29 1-69 1-59 1-48 1-59 1-41 
23 0-53 0-70 0-02 0-21 0-48 0-49 0-46 0:37 
24 2-40 1-70 4:34 3°80 2-73 2°55 2:79 2-91 
25 — 0-99 -—1-17 — 0-59 — 0-82 — 1-02 — 0-94 — 0-96 — 0-80 
26 0-79 0-99 0-26 0-54 0:77 0-74 0-75 0-60 
27 0:07 0-10 — 0-27 — 0-25 0-00 0-06 — 0-03 0-04 
28 0-82 1-02 0-2 0-58 0-81 0-77 0-78 0-63 
29 0-69 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
30 — 0-44 — 0-59 — 0-46 — 0-60 —0-51 — 0-41 —0-51 — 0-29 
31 1-20 1-33 0-77 1-16 1-25 1-16 1-23 1-04 
32 1-03 1-21 0-53 0-89 1-05 0-98 1-03 0-84 
33 — 1-25 — 1-37 — 0-63 — 0-89 — 1-24 —1-21 + 1-16 —1-10 
34 — 0-89 — 1-09 — 0°57 — 0-79 — 0-93 — 0-84 — 0-88 — 0-70 
35 0-78 0-98 0-25 0-52 0-76 0-73 0-74 0-59 
36 2-04 1-66 2-79 2-88 2-23 2-11 2-30 2-25 
37 0-81 1-01 0-28 0-57 0-79 0-76 0-77 0-62 
38 — 0-93 —1-12 — 0-58 —0-81 — 0-97 — 0-88 — 0-92 — 0-74 
39 0-53 0-70 0-02 0-21 0-48 0-49 0-46 0:37 
40 2-23 1-69 3°54 3°35 2-52 2-35 2-55 2-59 
41 1-27 1-38 0-88 1-28 1-33 1-23 1-32 1-12 
42 0-28 0-38 —0-15 — 0-06 0-21 0-26 0-19 0-18 
43 | —1-38 — 1-44 — 0-65 — 0-91 — 1-34 — 1-35 — 1-25 — 1-26 
44 — 0-77 — 0-97 — 0-55 — 0-75 — 0-82 — 0-72 — 0-79 — 0-58 
45 0-93 1-12 0-41 0-74 0-93 0-88 0-91 0-74 
46 2-90 1-73 7-64 5-27 3-32 3°15 3°55 3°94 
47 0-62 0-81 0-10 0-32 0-58 0-58 0-56 0-44 
48 — 1-30 — 1-40 — 0-64 — 0-90 — 1-28 —1-27 —1-19 —1-16 
49 l — 0-08 —011 — 0:34 — 0-37 — 0-16 — 0-07 —0-18 — 0-05 
50 0-04 0-06 — 0-28 — 0-27 — 0-04 0-04 — 0-06 0-02 
Z(x) | 15-81 14-56 16-81 16-92 16-11 16-02 16-41 16-43 
57-3619 112-8177 64-7851 | 58-6566 | 65-1299 | 62-5201 


























TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 







































































Fifteenth fifty 
eat Xs x3 X, | vs X x Xe 

1 —0-01 —0-01 — 0:30 —0-°31 — 0-09 —0-01 —0-11 —0-01 

| 2 0:08 0-11 — 0-26 — 0-24 0-01 0-07 — 0-02 0-05 

Ll © 2-51 1-71 4:93 4-12 2-86 2-69 2-95 3°13 

, « — 0-88 — 1-08 — 0°57 — 0-79 — 0-92 — 0°83 — 0°88 — 0-69 

| | 5 0-64 0:83 0-11 0-34 0:60 0-60 0:58 0-46 

| 6 0-14 0-19 — 0-23 —0-19 0:07 0-13 0-04 0-08 

| é 0-82 1-02 0-29 0-58 0-81 0°77 0-78 0-63 

cr & —0-51 — 0-68 — 0-49 — 0°64 — 0-58 — 0-47 — 0-57 — 0-35 

| 9 —1-75 —1-59 — 0-68 — 0:96 — 1-59 —1-77 — 1-52 —1-78 

| 10 0:47 0-63 — 0-02 0-14 0-42 0-44 0-39 0-32 

' | il 1-13 1-28 0-67 1-05 1-16 1-09 1-15 0-96 

| 12 1-13 1-28 0:67 1-05 1-16 1-09 1-15 0-96 

13 0:40 0-54 — 0:07 0:07 0°34 0:37 0-32 0-26 

| 14 —1:77 — 1-60 — 0-68 — 0-96 —1-61 —1-79 — 1-53 —1-81 

| 15 — 0-06 — 0-08 — 0-33 — 0-35 —0-14 — 0-06 — 0-16 — 0-03 

16 0:47 0-63 — 0-02 0-14 0:42 0-44 0-39 0-32 

| | 17 —0-18 — 0°25 — 0-38 — 0-44 — 0°26 —0-17 — 0-27 —0-11 

| 18 0:30 0-41 —0-14 — 0-04 0-24 0-28 0-21 0-19 

19 0-14 0-19 — 0-23 —0-19 0:07 0-13 0:04 0-08 

20 0-54 0-71 0:03 0-22 0-49 0-50 0:47 0:37 

21 — 0:07 — 0-10 — 0:33 — 0-36 —0°15 — 0-06 —0:17 — 0-04 

22 0-17 0:23 —0-21 —0:-16 0-10 0-16 0-07 0-10 

23 1-07 1-24 0°59 0:95 1-09 1-03 1-08 0:89 

24 2°75 1-72 6-47 4-81 3°15 2-98 3°31 3°62 

25 — 2°67 —1-72 —0-73 — 1-00 — 1-86* — 2-88 — 2-33 — 3-45 

26 — 0:43 — 0-58 — 0-46 — 0-59 — 0-50 — 0-40 — 0-50 — 0-29 

27 — 0-03 — 0-04 —0°31 — 0-33 —0-11 — 0-03 —0:13 — 0-02 

28 —1-10 — 1-26 — 0-61 — 0-85 —1-12 — 1-06 — 1-05 — 0-92 

29 — 0-24 — 0-33 — 0-40 — 0-48 — 0°32 — 0-22 — 0°33 — 0-15 

30 0-47 0-63 — 0-02 0-14 0-42 0:44 0:39 0-32 

31 1-14 1-29 0-68 1-06 1-17 1-10 1-16 0-97 

32 — 0°64 — 0-83 — 0-52 — 0:70 — 0-70 — 0-60 — 0-68 — 0-46 

33 — 0-46 — 0-61 — 0°47 —0-61 — 0:53 — 0:43 — 0-53 —0°31 

34 — 0-12 —0-17 — 0°35 — 0-40 — 0-20 —0-11 —0-21 — 0-07 

35 1-33 1-41 0-99 1-39 1-40 1-30 1:39 1-20 

36 — 1-05 — 1-22 — 0-60 — 0°84 — 1-07 — 1-00 —1-01 — 0-87 

37 — 1-20 — 1-33 — 0-62 — 0-88 | — 1-20 — 1-16 —1-12 — 1-04 

i 38 0:75 0:95 0-22 0-48 | 0:73 0-70 0-70 0-56 

39 0-11 0-15 — 0-25 — 0-22 0-04 0-10 0-01 0-06 

40 0:44 0-59 — 0-04 0-11 0:39 0-41 0:36 0-29 

41 — 2-39 —1-70 —0-72 — 0-99 — 1-85 — 2-54 — 2-04 — 2-89 

42 0-95 1-14 0°43 0:77 0-95 0-90 0:93 0:76 

43 — 0°54 —0-71 — 0-49 — 0°65 — 0-61 — 0-50 — 0-60 — 0°37 

44 — 0-93 —1-12 — 0-58 —0-81 — 0-97 — 0-88 — 0-92 —0:74 

45 — 0:86 — 1-06 — 0°57 — 0-78 —0-91 —0-81 — 0°86 — 0:67 

46 — 0-97 —116 | —0-59 — 0°82 — 1-00 — 0-92 — 0-95 —0:78 

47 — 1-28 —138 | —0-63 — 0:89 — 1-26 — 1-25 —1-18 —1-14 

| 48 0-08 0-11 — 0-26 — 0-24 0-01 0-07 — 0-02 0:05 

49 —0-12 —0°17 — 0-35 — 0-40 — 0-20 —0-11 —0-21 — 0:07 

| | 50 — 0-50 — 0°66 — 0-48 — 0-63 — 0-57 — 0°46 — 0°56 — 0°34 

x(x) — 2-73 — 2°45 1-09 — 1-32 — 2-22 — 2°73 — 2-59 —2-77 
54-1509 46°5775 76-7501 60-9554 52-2892 56-5775 54-6291 63-6593 









































































































TABLE OF STANDARDIZED RANDOM DEVIATES (vont.) 
Siateenth fifty 
sh 
| ad X v3 | vs X% a] Xs 
Bisa 
| g 
1 0-24 0-33 | -017 | —0-10 0-17 | 0-22 0-15 0-15 
2 | -0-57 -0-75 | —0:50 | —0-67 —0-64 | -053 | -0-62 | —0-40 
3 | -0-72 | -092 | -0-54 | -0-73 | -0-78 | —0-67 -0-75 | —0-53 
4 | -0-30 | -0-41 -0-42 | -052 | -0-38 | -0-28 | -0-38 | —0O-19 
5 0-88 1-08 0-35 | 0-66 0-87 0-83 | 0-85 0-69 
6 0:30 | 0-41 —014 | —0-04 0-24 0-28 | O21 0-19 
7 1-28 1-38 0-90 | 1:30 1-34 1:25 | 1:33 1-14 
8 | -1:38 | -144 | -065 | -0-91 —1:34 | -1:35 | -125 | -1-26 | 
9 1-68 1-57 1-72 2:07 | 1-83 1-69 | 1-83 1-68 | 
10 | -017 | -0-23 | —0-37 —0-43 | -0-25 | -016 | -0-26 | -010 | 
11 | —0-14 —0-19 —0-36 | -0-41 | -0-22 | -0-13 | —0-23 008 | 
12 0-68 0-87 O15 | 0:39 | 0-65 0-64 | 0-62 0:50 
13 0-18 0-25 | -021 | -015 | O11 0-17 0-08 0-11 
14 | -1-71 | -1-58 | -0-68 | —0-96 | ~1-57 -1-72 | -1-49 | -—1-73 
15 | -0-28 | -0:38 | —041 | -051 | -036 | -0-26 | -0:36 | —0-18 
16 0-94 | 113 0-42 | O75 | 0-94 0-89 0-92 0-75 | 
17 0-33 0-45 | -012 | -001 | 0-27 0:30 | 0-24 0-21 | 
8 | 118 | 132 | 0-74 113 | 1-22 1-14 1-21 1-02 
19 | —062 | —0-81 —0-51 -—0-69 | -069 | —0-58 —0-66 | —0-44 
20 | 169 | 157 174 | 209 1-84 1-70 1-84 1-69 
21 | -0-40 | -0-54 | -045 | -058 | -0-48 | —0-37 —0-47 — 0-26 
22 | -196 | -1-65 | -0-70 | -0-97 -1-71 —202 | —1-67 —2-12 
23 | -0-84 | -1-04 | -0-56 | -0-78 | -089 | -0-79 | -0:84 + —0-65 
24 | -0-54 | -0-71 —0-49 | -0-65 | —0-61 —0-50 | —060 | —0-37 
25 0-05 0-07 —0-28 | —0-27 | —0-03 0-05 | —0-05 0-03 
26 — 0-82 — 1-02 —0:56 | —0-77 — 0-87 —0-77 — 0:83 — 0-63 
27 0-46 0-61 | -003 | 0-13 0-41 0-43 | 0:38 0-31 
28 | —0-41 -0-55 | -0-46 | -0-58 | -0-49 | -0-38 | -0-48 | —0-27 
29 1-27 1:38 | O88 | 1:28 | 1-33 123 | 132 | 112 | 
30 | -1-22 | -1-35 | —0-63 | —0-88 | —1-21 -118 | —1-13 -1-06 | | 
31 176 | 160 | 193 | 224 | 1-98 178 | 1-93 1-80 
32 | -0-20 | -0-27 —038 | -0-45 | -0-28 | -018 | -0-29 | -O12 | 
33 | 105 | 1-22 | 056 | 092 | 1-07 1:00 | °1-05 0-87 | | 
34 | -0-95 | -1-14 | -058 | -081 | -0-99 | -090 | -0-93 | -0-76 | 
35 | -016 | —0-22 | -0:37 | -0-43 | -0-24 | -015 | —0-25 | —0-10 
36 | -111 | -1-27 | -061 | -o86 | —1-12 | -1-07 | -1-05 | —0-93 | 
37 0-97 | 1-16 0-46 | O80 | 0-98 0-92 | 0-96 0-78 | 
38 | (1:53 | (1-51 137 | #176 | 1-64 152 | 1-64 1-46 | 
39 | -0-05 | -0-07 —032 | -035 | -013 | -005 | -015 | -003 | | 
40 | 0-64 0-83 O11 | 0-34 | 0-60 0-60 | 0-58 0-46 | 
41 | -183 | -162 | -0-69 | —0-97 —164 | —1:86 | —1-58 -1-91 
42 | -0-73 | -0-93 | -0-54 | -—0-74 | —0-79 | -068 | -0-76 | —0-54 | 
43 1-26 1:37 087 | 127 | 1-32 1:22 | 1-30 Lll | 
44 | —O-11 -0-15 | -0:35 | -0-39 | -0-19 | -010 | -0-20 | -0-06 | 
45 0-02 0-03 | -0-29 | -0-29 | —0-06 0-02 | —0-08 0-01 | 
46 | -152 | -151 | -066 | -0-93 | -1-44 | -151 | -1-35 | -1-45 | | 
47 | —1-61 —155 | -0-67 | -0-94 | -151 —1-61 —1-42 | —1-58 
48 | -083 | -1:03 | -056 | -0-77 | -0-88 | —0-78 -0:84 | ~-0-64 
49 1-78 1-60 198 | 228 | 1-95 1-81 1-96 1-83 
50 0-29 0-40 | -014 | -0-05 | 0-23 0-27 0-20 0-18 
| | 
| aye es 
X(z) | -072 | -1-19 | -122 | -0-18 | -0-85 | -062 | -—0-37 — 0-30 
| 50-9664 | 45-1382 | 52-4567 | 49-6494 | 49-9199 
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TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 


























Seventeenth fifty 
v% Ve v3 aa v5 X% wy Xs 
1 — 0-75 — 0-95 — 0-54 —0-74 —0-81 — 0-70 —0-77 — 0-56 
2 — 0-47 — 0-63 — 0-47 — 0-62 — 0-54 — 0-44 — 0-54 — 0-32 
3 0-55 0-72 0-04 0-23 0-51 0-51 0-48 0-38 
4 0-87 1:07 0-34 0-65 0-86 0-82 0-84 0-68 
5 — 0-63 — 0-82 — 0-52 — 0-69 — 0-69 — 0-59 — 0-67 — 0-45 
6 — 0-60 — 0-78 —0-51 — 0-68 — 0-67 — 0-56 — 0-65 — 0-42 
7 0-85 | 1-05 0-32 0-62 0-84 0-80 0-82 0-66 
8 —0:86 | —1-06 — 0-57 —0-78 —0-91 —0-81 — 0-86 — 0-67 
9 0-79 0-99 0-26 0-54 0-77 0-74 0-75 0-60 
10 0-77 0:97 0-24 0-51 0-75 0:72 0-73 0-58 
11 —1-31 — 1-40 — 0-64 — 0-90 — 1-29 — 1-28 — 1-20 —1-:17 
12 1-02 1-20 0-52 0-87 1-03 0-97 1-02 0-83 
13 1-01 1-19 0-51 0-86 1-02 0-96 1-00 0-82 
14 — 0-69 — 0-88 — 0-53 — 0-72 —0-75 — 0-65 — 0-72 — 0-50 
15 — 0-59 —0-77 —0-51 — 0-67 — 0-66 — 0-55 — 0-64 — 0-42 
16 — 1-76 — 1-60 —- 0-68 — 0-96 — 1-60 — 1-78 —1-52 — 1-80 
17 0-47 0-63 — 0-02 0-14 0-42 0-44 0-39 0-32 
18 2-36 1-70 4:14 3-70 2-68 2-50 2-74 2-83 
19 — 0-88 — 1-08 — 0-57 — 0-79 — 0-92 — 0-83 — 0-88 — 0-69 
20 — 0-42 — 0-56 — 0-46 — 0-59 — 0-50 — 0:39 — 0-49 — 0-28 
21 0-06 0-08 — 0-27 — 0-26 — 0-02 0-06 — 0-04 0-03 
22 — 1-55 — 1-52 — 0-66 — 0-94 — 1-46 — 1-54 — 1-37 — 1-49 
23 0-92 1-11 0-40 0-72 0-92 0-87 0-90 0-73 
24 0-48 0-64 — 0-02 0-15 0-43 0-45 0-40 0-33 
25 0-88 1-08 0-35 0-66 0-87 0-83 0-85 0-69 
26 —2-01 — 1-66 —0-70 — 0-98 —1-73 — 2-08 —1-71 — 2-20 
27 1-62 1-55 1-57 1-95 1-75 1-62 1-75 1-59 
28 0-40 0-54 — 0-07 0-07 0:34 0-37 0-32 0-26 
29 1-94 1-64 2-46 2-64 2-15 1-99 2-16 2-09 
30 0-49 0-65 —0-01 0-16 0-44 0-45 0-41 0-33 
31 0-36 0-49 —0-10 0-02 0:30 0-33 0-27 0-23 
32 — 0-47 | — 0-63 — 0-47 — 0-62 — 0-54 — 0-44 — 0-54 — 0-32 
33 2-19 1-68 3-37 3°25 2-47 2-30 2-50 2-51 
34 1-22 1-35 0-80 1-20 1-27 1-18 1-26 1-06 
35 0-69 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
36 —0:70 — 0:89 — 0-53 — 0-72 — 0-76 — 0-66 — 0:73 —0-51 
37 — 1-27 — 1-38 — 0-63 — 0-89 — 1-25 — 1-23 —1:17 —1-12 
38 0-18 0-25 —0-21 —0-15 0-11 0-17 0-08 0-11 
39 0-98 1-17 0-47 0-81 0-99 0-93 0-97 0-79 
40 — 0-76 — 0-96 — 0-55 — 0:75 — 0-82 —0-71 — 0-78 — 0-57 
41 — 0-48 — 0-64 — 0-48 — 0-62 — 0-55 — 0-45 — 0-54 — 0-33 
42 1-49 1-50 1-29 1-69 1-59 1-48 1-59 1-41 
43 — 0°34 — 0-46 — 0-43 — 0-54 — 0-42 —0-31 — 0-42 — 0-22 
44 0-15 0-21 — 0-23 — 0:18 0-08 0-14 0-05 0-09 
45 —0:77 — 0-97 — 0-55 — 0-75 — 0-82 —0-72 — 0:79 — 0-58 
46 1-28 1-38 0-90 1-30 1-34 1-25 1-33 1-14 
47 —1-16 —1-31 — 0-62 — 0-87 —1-16 —1-12 — 1-09 — 0-99 
48 1-88 1-63 2-27 2-50 2-08 1-92 2-09 1-99 
49 — 0:67 — 0-86 — 0-53 —0-71 — 0-73 — 0-63 —0-71 — 0-49 
50 —0:78 — 0-98 — 0-55 —0-75 — 0-83 — 0-73 — 0-80 — 0-59 
X(x) 5-98 4:56 6-78 7-78 6-24 6-25 6-70 6-89 
x(a?) 56-3456 58-5270 53-9998 65-4558 60-9584 55-8065 59-2344 52-9191 









































TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 




















Eighteenth fifty 
a Hy v3 av Xs X% td Xs 
1 — 0-97 — 1-16 — 0-59 — 0-82 — 1-00 — 0-92 — 0-95 — 0-78 
2 2°38 1-70 4-24 3°74 2-70 2-53 2-76 2-86 
3 0-78 0-98 0-25 0-52 0-76 0-73 0-74 0-59 
4 0-35 0-47 —0-il 0-01 0-29 0-32 0-26 0-23 
5 1-10 1-26 0-63 1-00 1-13 1-06 1-11 0-92 
6 — 0-03 — 0-04 —0°31 — 0°33 —0-11 — 0-03 — 0-13 — 0-02 
7 — 1-47 — 1-49 — 0-66 — 0-93 —1-41 — 1-45 — 1-32 — 1-38 
8 0-68 0-87 0-15 0-39 0-65 0-64 0-62 0-50 
9 — 0-73 — 0-93 — 0-54 — 0-74 —0-79 — 0-68 — 0-76 — 0-54 
id —1-:17 —1-31 — 0°62 — 0-87 —1-17 —1-13 —1-10 — 1-00 
1l — 0-05 — 0-07 — 0-32 — 0°35 —0-13 — 0-05 —0-15 — 0-03 
12 1-02 1-20 0-52 0-87 1-03 0-97 1-02 0-83 
13 —0-19 — 0-26 — 0°38 — 0°45 — 0-27 —0-17 — 0-28 —0-12 
14 —0-°89 — 1-09 — 0°57 —0-79 — 0-93 — 0-84 —0-88 — 0-70 
15 0-56 0-74 0-05 0-25 0-52 0-52 0-49 0-39 
16 0-47 0-63 | —0-02 0-14 0-42 0-44 0-39 0-32 
17 — 0-70 — 0-89 — 0-53 — 0-72 — 0-76 — 0°66 — 0-73 —0-51 
18 1-49 1-50 1-29 1-69 1-59 1-48 1-59 1-41 
19 — 0-75 — 0-95 — 0-54 — 0-74 —0-°81 — 0-70 — 0-77 — 0°56 
20 1-03 1-21 0-53 0-89 1-05 0-98 1-03 0-84 
21 0-24 0-33 —0°17 —0-10 0-17 0-22 0-15 0-15 
22 — 0-42 — 0-56 — 0°46 — 0-59 — 0-50 — 0°39 — 0-49 — 0-28 
23 — 0-67 — 0-86 — 0-53 —0-°71 —0-73 — 0-63 —0-71 — 0-49 
24 — 1-32 —1-41 — 0-64 — 0-90 — 1-29 — 1-29 —1-21 —1-19 
25 0-20 0-27 — 0-20 —0-13 0-13 0-18 0-10 0-12 
26 1-31 1-40 0-95 1-35 1-38 1-28 1-37 1-17 
27 1-11 1-27 0-64 1-01 1-14 1-07 1-12 0-93 
28 —0-21 — 0-29 — 0°39 — 0-46 — 0-29 —0-19 — 0-30 — 0-13 
29 — 0-35 — 0-47 — 0-44 — 0-55 — 0-43 — 0-32 — 0°43 — 0-23 
30 — 2-76 —1-72 —0-°73 — 1-00 — 1-86* — 2-99 — 2°44 — 3°64 
31 — 0°63 — 0-82 — 0°52 — 0-69 — 0-69 — 0-59 — 0°67 — 0°45 
32 — 2°31 —1-70 — 0-72 —0-99 —1-83 — 2°44 — 1-96 — 2-74 
33 —0-01 —0-01 — 0-30 —0°31 — 0-09 — 0-01 —0-11 —0-01 
34 0-41 0-55 — 0-07 0-08 0-35 0:38 0-33 0-27 
35 3-02 1-73 8-72 5°65 3°45 3°29 3°74 4-21 
36 1-26 1-37 0-87 1-27 1-32 1-22 1-30 1-11 
37 0°36 0-49 —0-10 0-02 0-30 0-33 0-27 0-23 
38 — 0-43 — 0-58 — 0-46 — 0-59 — 0-50 — 0-40 — 0-50 -— 0-29 
39 — 0-26 — 0°36 —0-41 — 0-49 — 0°34 — 0-24 — 0°35 -— 0:16 
40 1-73 1-59 1-85 2-17 1-89 1-75 1-89 1-75 
41 — 0-64 — 0-83 — 0-52 — 0-70 — 0-70 — 0-60 — 0-68 — 0:46 
42 0-20 0-27 — 0-20 — 0-13 0-13 0-18 0-10 0-12 
43 — 2-08 — 1-67 —0-71 — 0-98 — 1-76 — 2-16 —1-77 — 2-32 
44 — 0-46 — 0-61 — 0-47 — 0-61 — 0-53 — 0-43 — 0-53 —0-31 
45 — 0-84 — 1-04 — 0-56 —0-78 — 0-89 — 0-79 — 0°84 — 0-65 
46 0-16 0-22 — 0-22 —0-17 0-09 0-15 0-06 0-10 
47 — 1-42 — 1-46 — 0°65 — 0-92 — 1-37 — 1-40 — 1-28 — 1-32 
48 0-20 0-27 — 0-20 —0-13 0-13 0-18 0-10 0-12 
49 1-34 1-42 1-00 1-41 1-41 1-31 1-40 1-21 
50 — 0-63 — 0-82 — 0-52 — 0-69 — 0-69 — 0-59 — 0-67 — 0-45 
x(x) — 0-99 — 1-66 6°31 3-10 0-16 — 0°88 — 0-07 — 0°38 
. 53-5924 | 111-1731 77-1048 62-0682 65-7264 65-6813 75-0474 




































































TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 
































Nineteenth fifty 

vy X Xs X vs % xy vs 

1 —0-19 — 0-26 — 0-38 — 0-45 — 0-27 —0-17 — 0-28 —0-12 

2 0-13 0-18 — 0-24 — 0-20 0-06 0-12 0-03 0-08 

3 — 0-82 — 1-02 — 0-56 —0-77 — 0-87 —0°77 — 0-83 — 0-63 

| 4 — 0-18 — 0-25 — 0-38 — 0-44 — 0-26 —0-17 — 0-27 -—0-11 
L: @ — 2-43 -—1-71 — 0-72 — 0-99 — 1-85 — 2-59 — 2-08 — 2-97 
6 0-78 0-98 0:25 0-52 0-76 0-73 0°74 0-59 

7 — 0-98 —1:17 — 0-59 — 0-82 —1-01 — 0-93 — 0-95 —0-79 

8 — 0-09 —0-12 — 0-34 — 0-38 —0-17 —0-08 —0-19 — 0-05 
9 —0-81 —1-01 — 0-56 —0-77 — 0-86 — 0-76 — 0-82 — 0-62 

10 0:56 0°74 0:05 0-25 0-52 0-52 0-49 0-39 
ll — 2-32 —1-70 —0-72 — 0-99 — 1-34 — 2-46 —1-97 — 2:75 

12 0-01 0-01 — 0-30 — 0-30 — 0-07 0-01 — 0-09 0-01 
13 — 0-90 — 1-09 — 0-57 — 0-80 — 0-94 — 0°85 — 0-89 -—0-71 

14 0-22 0:30 —0-19 —0-12 0-15 0-20 0-13 0-14 
15 — 1-36 — 1-43 — 0-64 —0-91 — 1-32 — 1-33 — 1-24 — 1-24 

16 0-65 0°84 0-12 0:36 0-62 0-61 0-59 0:47 
17 0-39 0:53 — 0-08 0-05 0-33 0°36 0-30 0-26 

18 0:53 0-70 0-02 0-21 0-48 0:49 0-46 0-37 
19 0-81 1-01 | 0-28 0°57 0-79 0:76 0°77 0-62 
20 0-91 1:10 | 0-39 0-71 0-91 0:86 0-89 0-72 
21 —0-14 —0-19 | —0-36 —0-41 — 0-22 —0-13 — 0-23 — 0-08 
22 1-76 1-60 | 1:93 2-24 1-93 1:78 1-93 1-80 
23 1:19 1:33 0-76 1:15 1-23 1:15 1-22 1-03 
24 1-41 1-46 1-13 1:53 1-50 1:39 1-49 1-30 
25 — 1-00 —1-18 — 0-59 — 0-83 — 1-03 — 0-95 —0-97 —0-81 

26 — 1-20 —133 | —0-62 — 0-88 — 1-20 —1-16 —1-12 — 1-04 
27 0-71 0-90 0-18 0-43 0-68 0-66 0-66 0:52 
28 — 0-59 —0-77 —0-51 — 0-67 — 0:66 — 0°55 — 0-64 — 0-42 
29 — 1-38 — 1-44 — 0-65 —0-91 — 1-34 — 1-35 — 1-25 — 1-26 

| 30 2-17 1-68 3-29 3-20 2-44 2-27 2-47 | 2-48 
31 0-30 0-41 —0-14 —0-04 0-24 0-28 0-21 | O19 

32 0-51 0-68 0-01 0-19 0:46 0:47 0-44 | 0-35 
33 — 0-07 —0-10 — 0-33 — 0:36 —0-15 — 0-06 —0-17 — 0-04 

| 34 0:55 0:72 0-04 0-23 0:51 0-51 0-48 0:38 
| 35 0-52 0:69 0-02 0-20 0:47 0:48 0:45 0:36 
| 36 0-01 0-01 — 0-30 — 0-30 — 0-07 0-01 — 0-09 0-01 
37 1-37 1:44 | 1-06 1-46 1-45 1-34 1-44 1-25 
38 0-82 1-02 0-29 0:58 0-81 0:77 0-78 0-63 
39 — 0-08 -0-11 — 0-34 — 0-37 —0-16 — 0-07 —0-18 — 0-05 
40 — 0-25 — 0-34 — 0-40 —0-49 — 0-33 — 0-23 — 0-34 —0-16 
41 1-32 1-41 0:97 1:37 1-39 1-29 1-38 1-19 
42 — 0-50 — 0-66 — 0-48 — 0:63 — 0-57 — 0-46 — 0-56 — 0-34 

43 — 0-04 — 0-06 — 0°32 — 0-34 —0-12 — 0-04 —0-14 — 0-02 
44 0-98 1:17 0:47 0-81 0-99 0-93 0:97 0-79 

| 45 — 0-50 — 0-66 — 0-48 — 0-63 — 0-57 0:46 — 0-56 — 0-34 
| 46 0-51 0-68 0-01 0-19 0:46 0:47 0:44 0-35 
| 47 1-59 1-54 1-51 1-88 1-72 1:59 1-71 1°55 
| 48 0-44 0-59 — 0-04 0-11 0-39 0-41 0-36 0-29 
| 49 0:97 1:16 0:46 0-80 0-98 0-92 0:96 0-78 
| 50 —1-29 — 1-39 — 0-64 — 0-90 — 1-27 — 1-26 —1-19 —1-15 
x(x) 5-00 6-89 0:77 3-34 5-12 5:47 4-74 3-20 
48-4038 | 49-4833 | 27-9639 | 40-9940 | 47-0018 | 48-2137 | 46-6414 | 46-8674 






































TABLE OF STANDARDIZED RANDOM DEVIATES (cont.) 















































Twentieth fifty 
| 
a Xs X3 X4 Xs Xe | _ 2g 
| | | | Zz = 
1 131 | 1-40 0-95 1-35 1-38 1-28 1-37 1-17 
2 | -017 | -0-23 | -0-37 | -043 | -0-25 | -0-16 | -0-26 | —0-10 
3 | -095 | -114 | -0-58 | -0-81 | -099 | -0-90 | -0-93 | —0-76 
4 0-69 | 0-88 0-16 0-41 0-66 0-65 0-63 0-50 
5 0-32 | 0-43 | -013 | —0-02 0-26 0-30 0-23 0-20 
| 
6 0-26 | 036 | -016 | -008 | 0-19 0-24 0-17 0-16 In 
7 | -039 | -053 | -045 | -057 | -0-47 | -0:36 | -0-46 | —0-26 Ty 
8 | -0-50 | -066 | -0-48 | -063 | -0-57 | -0-46 | -0-56 | —0-34 
9 1-91 1-63 2-36 2-57 211 1-96 213 | 204 
10 | 237 | 1-70 4:19 3-72 2-69 2-52 275 | 285 
11 | 4177 | 1-60 1-95 | 2-26 1-94 1-79 194 | 1-81 Th 
12 | -0-09 | -0-12 | -034 | -038 | -017 | -008 | —0-19 | — 0-05 dey 
13 | -0-62 | —0-81 -051 | -069 | -0-69 | -058 | -0-66 | —0-44 pri 
14 | -102 | -120 | -060 | -0-83 | -105 | -097 | -0-99 | —0-83 of 
15 | -0-54 | -0-71 -0-49 | -0-65 | -0-61 —0:50 | -—060 | —0-37 Qe 
j | 
is | 007 | 010 | -027 | —0-25 0-00 0:06 | —0-03 | oor | | ft 
17 | -016 | -0-22 | -037 | -0-43 | -0-24 | -015 | -0-25 | -0-10 | 
1s | -1-44 | -147 | -065 | -0-92 | -1-39 | -1-42 | -129 | —1-34 | re 
19 | -0-60 | -078 | -051 | -068 | -0-67 | -0-56 | —0-65 | — 0-42 rc 
20 | —0-23 | —0-32 | —0-40 | -047 | —0-31 —0-21 —0:32 | -0-14 je 
21 | -067 | -o86 | -o53 | -0-71 -0-73 | -063 | -0-71 | — 0-49 be 
22 | 156 | 1-53 1-44 | 1-82 1-68 1-55 168 | 151 
23 0-51 | 0-68 0-01 0-19 046 0-47 0:44 | 0-35 oc 
24 | 0:33 | 0-45 | -012 | —0-01 27 | 0-30 0-24 | 0-21 
25 | -001 | -001 | -030 | -0:31 —0-09 | -0-01 -0-11 —0-01 | po 
26 | O13 | O18 | —0-24 | —0-20 0-06 0-12 0-03 | 0-08 | th 
27, | O81 | 1-01 0-28 | 0-57 0:79 0-76 0-77 0-62 0- 
28 | -109 | -1-25 | 0-61 | -085 | -1-11 | -1-05 | —1-04 | —0-91 | th 
29 | —0-90 | -109 | -057 | -0-80 | -0-94 | -0-85 | -0-89 | -0-71 gi 
30 | -0:39 | -0-53 | -0-45 | -057 | -0-47 | -0:36 | -0-46 | -0-26 | sh 
31 0-57 075 | 0-06 026 | 083 | 058 0-50 | 0-40 | ie 
32 | -088 | -1-08 | -057 | -0-79 | -092 | -083 | =0-88 | —0-69 | «& 
33 | (0-57 075 | 0:06 | 0:26 | 053 | 0-53 0:50 | 0-40 th 
34 0-98 117 | 0-47 |. 081 | 0-99 0-93 0-97 | 0-79 th 
35 | — 0-38 0-51 | -0-45 | -0-57 | -0-46 | —0-35 —0-46 | —0-25 th 
36 | -1-06 | -1-:23 | —0-60 | —0-84 | -1-08 | -1-01 — 1-02 | ~ 0-88 it 
37 1-79 1-60 201 | 2-30 1:96 | 1-82 1-97 | 1:85 
38 0-00 0-00 | -0:30 | -0-31 — 0-08 0-00 | -010 | 0-00 
39 0-23 0-32 | -018 | -O-11 0-16 0-21 O14 | O14 
40 0-21 0-29 | —0-19 | —0-12 0-14 0-19 O11 | 0-13 N 
41 | -0-76 | -096 | -0-55 | -0-75 | -082 | -0-71 -0-78 | -057 | di 
42 | -0-94 | -113 | -058 | —0-81 —0-98 | -0-89 | -092 | -0-75 | ti 
43 | -0-98 | -1-17 | -0-59 | -0-82 | -1-01 | -093 | -0-95 | —0-79 
44 0-97 1:16 | 0-46 | 0-80 0-98 0-92 0-96 0-78 
45 | -064 | -0-83 | —0-52 | -070 | -0-70 | 0-60 | -068 | —0-46 
46 | 016 0-22 | -022 | -0-17 0-09 0-15 0-06 0-10 
47 | -1:39 | -1-45 | -0-65 | -0-91 -1:35 | -1-37 | -1-:26 | —1-28 
48 | -0-03 | -004 | -0-31 | -0-33 | -0-11 -0-03 | -0-13 | —0-02 
49 0:36 0-49 | —0-10 0-02 0:30 0-33 0-27 0-23 
50 | -0-87 | -107 | -057 | -0-79 | -0-92 | -0-82 | -0-87 | —0-68 
R: a oil a 
L(a) 018 | -270 | -111 -1-97 | -1-01 0-82 | —0-59 2-46 
43-9182 | 42-0127 | 51-0911 | 45-1523 | 39-0722 | 43-5785 | 35-7298 
























































Note on Mr Quenouille’s Edgeworth Type A transformation 


By E. 8. PEARSON 
University College London 


In representing a non-normal frequency function, f(z), by a limited number of terms of an Edgeworth 
Type A expansion, statisticians have frequently used the form 


1 2 
He) = Tom eis" ( +72 (a*— 30) + (x— 622 +3) +5 (a® — 1504+ 4522—15)). (1) 


This distribution, for example, formed the basis of Gayen’s (1949, 1950) papers exploring the effect of 
departure from normality on several common statistical tests. It is also used by Srivastava in a paper 
printed elsewhere in this issue of Biometrika. It is important to realize, however, that the distributions 
of x;, %, and x, derived from a normally distributed x, through the Cornish—Fisher equations given by 
Quenouille on p. 179 above, will not correspond exactly to particular cases of the frequency function (1). 
It seemed of interest to examine the extent of this difference. 


(i) For the case xk, = 0-5, kK, = 0-0, f(x) of equation (1) becomes negative* at x; = — 2-53, the negative 
area under the curve beyond this point amounting to — 0-0028. This means that the area above — 2-53 
is 1-0028 or is in excess by 3 in 1000. For the Quenouille transformation the critical point is atx; = — 1-86. 


Thus there is inevitably some disagreement between the two distributions at the lower tail. It was found 
that at the upper tail there was good agreement up to 2, = 3-2, beyond which 2; for distribution (1) 
begins to increase steadily over Quenouille’s value given in his table on p. 182. 

(ii) For the case x, = 0-0, xk, = 0-5, f(x) for (1) does not become negative and the two 2, distributions 
scarcely differ until after x, = + 3-4. 

(iii) For the case of x, = 0-5, k, = 0-5, the f(x) of equation (1) becomes negative at x, = — 2-65 and 
positive again at about x, = — 3-35, but the effect of this anomaly is much smaller than for x,. Since 
these extreme negative and positive areas almost cancel out, the area under the curve above — 2-65 is 
0-99996 or only negligibly in error. In the lower tail, the values of x, obtained from (1) do not differ from 
those in Quenouille’s table by more than 0-05 until 7, = — 2-1; beyond this point Quenouille’s x,, for 
given x,, assumes increasingly greater negative values than the 2, of (1). However, as the table below 
shows, this difference is unlikely to be noticeable in a sample of 1000. 

In this table are given the expected frequencies for the two asymmetrical Edgeworth distributions of 
equation (1), expressed in terms of totals of 1000. These are compared with Quenouille’s two samples 
tabled on p. 181. The only appreciable difference is at the lower end of the distribution of x;. For (1) 
there is an expected frequency of 8-6 in the interval — 2-0 to — 2-53, while no observations are possible in 
this range using Quenouille’s transformation. However, if the y* test for goodness of fit is used to compare 
the sampled frequencies with the expectations tabled below, pooling tail groups as shown by the braces, 
it is found that 


(a) fork, = 0-5, xy=0-0: yxy? =6-29, v=13; 
(b) fork, = 0-5, «k,= 0-5: y®? = 15-65, v= 14. 
Neither of these values is significant. One must conclude therefore that except at the lower tail of the 2, 


distribution it would be difficult to detect any difference between Quenouille’s three Edgeworth distribu- 
tions and those derived from the commonly used form of equation (1),even in samples as large as 1000. 
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* This is to be expected from Barton & Dennis’s (1952) investigation. £, = «3 and £, = «,+3 give 
a (2, 8.) point outside the region in which the f(x) of (1) is positive definite. 
+ That is, no difference between the corresponding values of over 0-05. 


Comparison of Edgeworth Type A distributions 


Note on Mr Quenouille’s Edgeworth Type A transformation 





Case x, = 0-5, k, = 0-0, 
i.e. distribution of x; 


Case k, = 0-5, Kk, = 0-5, 
i.e. distribution of x, 
































x 1 
Expectation Quenouille’s Expectation Quenouille’s 
from (1) sample from (1) sample 

> 40 0-4 _. 0-5 — 
3-6 to 4-0 os —_ ri} 1 
3-2 to 3-6 1:8 3 2-5 3 
2-8 to 3-2 3-9 2 5-0 1 
2-4 to 2:8 8-4 11 9-3 13 
2-0 to 2-4 17-5 10 16-7 8 
1-6 to 2-0 33-8 33 30-0 33 
1-2 to 1-6 57-5 60 51-7 58 
0-8 to 1-2 85:8 87 82-3 79 
0-4 to 0-8 114-9 120 117-9 116 
0-0 to 0-4 140-7 145 149-8 146 
-—0-4 to 00 155-6 154 164-7 167 
—0:8 to —0-4 149-0 154 152-1 174 
—1:2 to —08 117-4 117 | 113-9 112 
—1-6 to —1-2 | 72-0 66 | 66-3 56 
—2:0 to —1-6 31-9 38 | 28-1 26 
—2-4 to —2-0 | 8-3 — | 7:5 5 
<—2-4* | 0-3 — | os} 2 

| | 

| | 
Total ! 1000-0 1000 | 1000-0 1000 

| 











* For equation (1), the lower limit for 2, is — 2-53 and for x, it is — 2-65. 
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MONOMIAL-MONOMIAL SYMMETRIC FUNCTION TABLES 


By JACK LEVINE 
University of North Carolina, Raleigh 


1, The present monomial-monomial (MM) Table is a continuation of the David—Kendall 
Tables (1949), (1951), (1953), (1955). All monomial products up to and including weight 
w = 8 are listed as linear functions of monomials. Thus, Table 8, section (iii) and (iv), gives 


(21)? (2) = (62) + 2(61%) + 2(53) + 2(521) + 2(42) + 4(431) + 8(422) + 6(4212) + 6(3?2) 
+ 8(3221) + 24(24) + 12(2312). 


2. The use of MM expansions in problems of distributions is illustrated by a theorem of 
MacMahon. 

The number of distributions of n objects of specification [m,m, ... m,] in r different boxes 
B,, ..., B,, such that B; contains p; objects of specification [m,,;m.; ...m,,;] is given by the 
coefficient C,,,, ... m, of the monomial symmetric function (m, ... m,) in the expansion of the 
product 

(m1 Mzq, «-- My,1) (My2Mg9 --- M452) s++ (My,Moy «.- My,r) = =C,, seg AM a 


the summation being over all partitions [q, ...¢,] of mn = X¢; = Xp;. 


3. Construction of the Tables was based on MacMahon’s D-operator, the Tables of lower 
weight being used to build up those of higher weight. Checks were obtained by multiplica- 
tion of factors in different orders. 


The writer is indebted to Mr Charles N. Anderson for his valuable aid in the construction 
of these Tables. 
Work on these Tables was supported by Office of Naval Research Contract Nonr 870(00). 
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MISCELLANEA 


Approximate linearization of the incomplete /-function 


By A. W. KIMBALL anp E. LEACH 
Oak Ridge National Laboratory, Tennesseet 


1. IntTRODUCTION 


The incomplete /-function has been a favourite subject with statisticians for many years because it 
arises frequently in our work and because it presents problems in evaluation. Several tables of this 
function and related functions have been constructed and many approximations have been derived. 
Wise (1950) gives an excellent account of various approximations in terms of percentage points of the 
x?-distribution and provides methods for computing percentage errors. From his paper, and other 
literature which is too voluminous to review here, one can ascertain that most efforts have been directed 
toward the numerical evaluation of either the function itself or of one of its arguments, usually in 
connexion with the determination of Type I or Type II errors for test statistics, the construction of 
confidence intervals, or the determination of sample sizes. When one attempts to use existing formulae 
and tables, one is immediately impressed by the fact that no single table or formula is sufficient for every 
purpose. Tables may be unsatisfactory either because the range of the arguments is too narrow or because 
interpolation is required. The approximation formulae may be unsatisfactory because they are derived 
for significance tests or confidence intervals and hence are restricted to percentage points usually near 
the tails of the distribution. 

The approximation reported in this paper resulted from the need for a single representation of the 
incomplete /-function that would be valid over wide ranges of the function and the three arguments. In 
radiation mortality studies, an approach known popularly as ‘target theory’ predicts that, for some 
organisms, the probability (M) of death from a dose (D) of radiation is given by 


p+q-1 . 
M= & Oft?*gi(1—x)?+e-1-4 = I(p,q), 
i=p 


where p and q are unknown parameters, x is a function of D, and I,(p, q) is Pearson’s (1934) notation for 
the incomplete beta function, i.e. 


1 
1,(p, 4) = [Fea —1-ae/ i) "el —oetde 


From observations on M and D, regression estimates may be obtained, although the use of I,(p, q) as an 
expected value presents formidable difficulties. To avoid these difficulties, various attempts were made 
to find a transformation that would provide an approximate linear relationship between functions of the 
dependent and independent variables. To be of any value the approximation had to be satisfactory over 
almost the entire range of I,(p,q) and had to be valid for values of p, g which were unknown, and for 
values of x which varied over an unknown range. A search of the literature revealed that, for reasons 
already cited, no available single formula would suffice. However, by combining two formulae found in 
the literature and by making one modification, we arrived at a linear transformation that proved 
adequate for the regression problem. Although it is less accurate than some approximations for the 
purpose of evaluating I,(p, q), it has obvious advantages for use as an expected value in the curve-fitting 
problem. 


2. THE APPROXIMATION 


In connexion with a sample size problem, Scheffé & Tukey (1944) give, as an approximate solution to the 
equation J,(p,q) = a, + 


(p+a-1) = 4at(7**) + 40-, (1) 


where x? is the 100 « % point of the y?-distribution with 2g degrees of freedom. They indicate that for 
0-005 < a < 0-10 and x > 0-9, the error in this solution is less than 0-1 %. It also does well for larger 


+ Operated by Union Carbide Corporation for the U.S. Atomic Energy Commission. 
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values of « but becomes inaccurate as x is decreased. We have found that the approximation can be 
extended to smaller values of x if the first term is multiplied by 


wa ks “1 
hee ee 
(+ Ton t 3° ) (2) 


The following modification of the Scheffé-Tukey approximation has been obtained by Tukey (1958) 
x2 = 2q(1— x) + (2p—1) (1/yx—,/z). (3) 


Computations over the range of arguments in Table 1 show that this new form is remarkably superior to 
the original approximation. Unfortunately, it does not permit linearization of the regression problem. 
Wilson & Hilferty (1931) give the following approximation to x?, 


* = 29 (1-+4 Ja) . 
Aa q 9q Y1-a 9q ’ (4) 


M-« J] 
is defined b —— e-t* dt = a. 
where ¥;_, is defined by ie Jan) e a 
According to the results of Goldberg & Levine (1946), the Wilson—Hilferty approximation, when com- 
pared with the three others, does best over a wider range of arguments and hence was chosen for use in 
our regression problem. 
By combining (4) with (1) as modified by (2), one obtains 


Yo = A+BX, (5) 


ze 2p — 17] 
where A=—_, B= —34q| 14° , 


1-2z\/21 1 1 $ 
Be ee, ee 
* [ (3) (5+ 19x * 3° )] 


Thus, for any 2, p and q, y, can be computed readily and the approximation, 


Ya 1 
f=1,(,q) = 
a(P> 4) _ co Vm) 
obtained from tables of the normal distribution. The advantage of this approximation in the afore- 
mentioned regression problem should be obvious. Not only is the problem linear, but the dependent 
variable plus five is a probit, and the literature abounds with computing aids for probit analysis. 
By combining (3) with (4), one obtains 


2p—1 (1—2x\ ]* 
te = A-3qa (1-2) +2 (=) | . (7) 
In Table 1, the approximation obtained from (7) is identified as /*. For evaluating I,(p, q), this form is 
definitely superior to (5), but it is of little use in the regression problem. 

In Table 1, three approximations are compared with exact values as obtained from Pearson’s (1934) 
tables and from the Harvard tables (1955). The range covered is 2 < p < 500and 1 < q < 451 for each of 
four values of x chosen so that no interpolation would be required to obtain the exact values and so that 
I,({p, 7) would have values near 0-05, 0-30, 0-70 and 0-95. To conserve space, the values of x are not shown. 
The ranges of p and q correspond to sample sizes between 2 and 951 for the related binomial distribution. 
Since, for large values of p and q, the direct normal approximation to I,(p,q) would be expected to io 
quite well, Table 1 also contains the approximation obtained by taking 


_ P(L—x)—a(g—1)— 05 
Ya = “T(p+q—1)a(1—2)} 


In Table 1, the approximation obtained from (8) is identified as I’. 


e~t* dt, (6) 











(8) 


3. GOODNESS OF THE APPROXIMATIONS 


Inspection of Table 1 shows that f does generally better than J’ for values of p < 80 and g < 41 except 
where p and q are about equal. This latter case corresponds to a probability near one-half for the binomial 
distribution in which case the normal approximation provides good accuracy even for relatively small 





I = exact value 
f= approximation from (5) and (6) 


(Numbers in parentheses are errors to the nearest third decimal.) 
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Table lf. Approximations to I,(p, q) 


I’ = approximation from (6) and (8) 


I* = approximation from (6) and (7) 





























Pp qd | Xv 3 a2 
2 1 I 0-04840 0-30250 0-70560 0-94090 
Pf ‘05109 (+ 3) -30871(+ 6) *71294 (+ 7) ‘93178 (— 9) 
fig ‘03519 (— 13) -28483 (— 18) *63577 (— 70) *96591 (+ 25) 
I* -04724 (— 1) -31094 (+ 8) *71291 (+ 7) *93149 (— 9) 
2 2 I 0-05331 029549 0-70451 0-94669 
f -04478 (— 8) *28806 (— 7) *70235 (— 2) -94316(— 4) 
I’ -03617 (—17) -30672 (+11) -69328 (— 11) -96383 (+17) 
I* -05120(— 2) -30762 (+12) *71137 (+ 7) -94360 (— 3) 
5 2 I 0-05097 0-30065 0-70441 0-95408 
r -05247 (+ 2) -30372 (+ 3) -70941 (+ 5) *95176 (— 2) 
4 ‘05074 ( = 0) +28728 (—13) -67231 (—32) -97499 (+21) 
Pins ‘04987 (— 1) +30253 (+ 2) -70829 (+ 4) *95134 (— 3) 
5 4 I 005054 029985 0-70640 0-:95244 
T ‘04715 (— 3) +29179 (— 8) *70221(— 4) *95055 (— 2) 
r -04470 (— 6) -30007( = 0) -69808 (— 8) -96282 (+10) 
I* ‘04887 (— 2) +30346 (+ 4) -70939 (+ 3) -95113 (— 1) 
12 2 I 0-04731 0-29205 0-72063 0-94363 
Tr -04884 (+ 2) -29602 (+ 4) -72649 (+ 6) *94207 (— 2) 
I’ ‘05688 (+ 10) *27212 (—20) -68092 (— 40) *96444 (+21) 
I* -04661( 0) -29187( 0) *72385 (+ 3) *94142 (— 2) 
12 6 I 0-05167 0-29231 0-70109 0-94521 
Fi ‘05197 ( = 0) *29274( 0) -70258 (+ 2) 94505 ( = 0) 
¥ -05246 (+ 1) -28709 (— 5) -69045 (-- 11) *95403 (+ 9) 
a ‘05093 (— 1) *29312 (+ 1) -70265 (+ 2) *94469( 0) 
12 10 Fj 0-04811 029888 0-69144 0-94519 
i -04280 (— 5) *28367 (— 15) -67950 (— 12) *94193 (— 3) 
Pig -04591(— 2) -29868( 0) *68792 (— 4) *94949 (+ 4) 
I* ‘04701 (— 1) +30057 (+ 2) -69304 (+ 2) *94450 (— 1) 
30 5 I 0-:04909 0-29168 0-68274 0-94936 
I -05149 (+ 2) +29782 (+ 6) -68925 (+ 6) *95013 (+ 1) 
I’ ‘05657 (+ 8) +27948 (—12) -66150 (— 21) *96217 (+13) 
I* -04878( 0) -29138( 0) -68408 (+ 1) *94894( 0) 
30 15 I 0-05268 0-29271 0-72342 0-95542 
Hy -05389 (+ 1) *29295( = 0) -72409 (+ 1) *95540( 0) 
I’ -05413 (+ 1) *28917(— 4) *71840 (— 5) -96030 (+ 5) 
I* ‘05227( = 0) *29312( 0) -72409 (+ 1) ‘95518 ( 0) 
30 25 f 0-04282 0-29726 0-69384 0-94300 
Mg ‘03596 (— 7) +27380 (— 24) -67286 (— 21) -93690 (— 6) 
Si -04216(— 1) -29683( 0) -69210(— 2) *94495 (+ 2) 
I* -04215 (— 1) -29810(+ 1) -69469 (+ 1) *94255( 0) 
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Table 1 (cont.) 
| 
Pp q xy Xo Xs Wy 
so | ll | I 0-05292 0-26911 0-71251 0-95032 
— }{ ft -05644 (+ 4) -27806 (+ 9) -72087 (+ 8) -95220 (+ 2) 
lr’ -05892 (+ 6) -26175 (— 7) -70092 (— 12) -95864 (+ 8) 
* I* -05277( 0) -26882( 0) -71307 (+ 1) -95021( 0) 
25) so | 41 | I 0-05198 0-30621 0-66294 0-94966 
9) Tt -05184( 0) -30574( 0) -66270( 0) -94957( 0) 
I’ -05318 (+ 1) -30380(— 2) -69545 (+32) -95210 (+ 2) 
‘ I* -05176( 0) -30644( 0) -66336( 0) 94949( 0) 
17) 80 71 I 0-04292 0-31229 0-68943 0-95914 
3) Tt -03102 (— 12) -26657 (— 46) -64480 (— 45) -94845 (—11) 
r -04270( 0) -31207( 0) -68877 (— 1) -95994 (+ 1) 
. I* -04250( 0) -31286 (+ 1) -69000 (+ 1) -95881( 0) 
' 
21) 20 | 41 | I 0-05543 0-33028 0-65056 0-95911 
3) r -06088 (+ 6) -34758 (+17) -66684 (+16) -96240 (+ 3) 
lV’ -05833 (+ 3) -32504 (— 5) -64422 (— 6) -96287 (+ 4) 
‘ I* -05536( 0) -33029( 0) -65079 (0) -95909( 0) 
10) 200 | 121 | J 0-05711 0-31223 0-73254 0-96066 
1) yi -05237 (— 5) -29822 (— 14) -72022 (—12) -95763 (— 3) 
I’ -05770 (+ 1) -31107 (— 1) -73147 (— 1) 96175 (+ 1) 
‘ I* -05694( 0) -31254( 0) -73274( 0) -96051( 0) 
1) 200 | 181 | I 0-03961 0-27940 0-72157 0-96143 
2) ft -02318 (— 16) -20972 (—70) -64741 (—74) -94193 (—20) 
r’ -03956( 0) -27930( 0) -72129( 0) -96179( 0) 
e I* -03935( 0) -27969( 0) -72184( 0) -96120( 0) 
9) 500 | 101 | Z 0-02152 0-21393 0-69515 0-97166 
0) Tt -02607 (+ 5) -23660 (+ 23) -71934 (+ 24) 97562 (+ 4) 
I’ -02328 (+ 2) -21273 (— 1) -69186 (— 3) -97389 (+ 2) 
‘ I* -02150( 0) -21391( 0) -69533( 0) -97162( 0) 
4) 500 | 301 | I 0-02364 0-20249 0-63018 0-93511 
1) Tt -02029 (— 3) -18566 (—17) -60799 (— 22) -92779 (— 7) 
I’ -02403( 0) -20225( 0) -62912 (— 1) -93569 (+ 1) 
am I* -02357( 0) -20236( 0) -63030( 0) -93507( 0) 
3) 500 | 451 | I 0-05592 0-36063 0-60280 0-93303 
0) I -02576 (— 30) -24218 (—118) -47013 (—133) | -88040 (— 53) 
I’ -05594( 0) -36048( 0) -60258( 0) -93319( 0) 
“ I* 05578 (0) -36096( 0) -60313( 0) -93294( 0) 
5) 
+ Abridged from a larger table available from the author on request. 
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sample sizes. On the other hand, the approximation given by /is not too bad for these cases, particularly 
for purposes of regression, and its accuracy tends to improve as x increases. As expected, for p > 80and 
q > 41, the normal approximation is uniformly better than f and in fact is good enough for almost any 
practical purpose including the regression problem. 

The approximation J* is surprisingly accurate over the ranges examined and even competes success- 
fully with I’ for large p and q. Although / does not have the uniform accuracy of I*, or of I’ for large 
p and q, it is detinitely preferable for use in the regression problem in the lower ranges of p and q. Perhaps 
it should be emphasized that all of these approximations may be used, without the need for interpolation, 
for integral or fractional values of p and q, the only tables required being the readily available tables of 
the normal distribution. 
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Sequential occupancy 


By D. E. BARTON anp F. N. DAVID 
University College London 


INTRODUCTION 


In previous papers (Barton & David, 1959a,b) we have discussed the distribution of the number of 
empty compartments when n balls are randomly and independently thrown into N identical compart- 
ments. Various restrictions on the compartments have been envisaged. The alternative problem where 
the number of empty compartments is fixed and the number of balls becomes the random variable is not 
without interest. The classical case corresponding to De Moivre’s differences of zero distribution is, of 
course, well known, but we think that this is not true of the other cases discussed below. 

The actual distributions are simply and easily obtained. Suppose k zero compartments and let the 
distribution of n, the number of balls required to fill just N—-k compartments, be defined. Then the 
probability of n is equal to the probability that n—1 balls will fill N—k-—1 compartments times the 
probability that one further ball falls in an empty compartment. This argument will hold whether there 
is restriction on the compartment size or not, and the sequential distributions thus follow from our 
previous work (1959a). The generalization of Pélya’s scheme has also been noted previously. 

The moments of the distribution of n are not easy to find unless the actual probability process is 
investigated (see for example Feller, 1957, p. 210). We discuss here methods of obtaining these moments. 


CLASSICAL CASE WITH NO RESTRAINT ON BALLS OR COMPARTMENTS 
The probability distribution of n is 


1 k+1 1 
p(n) = aac 8On AN-HH00-1 = as Ne-i N-1¢, AN-k-109n-1 (n = N-—k,N-—k+ Rive 0), 





a fact which is well known. The moments of n are straightforward. Suppose the dropping of the balls is 
going on and we break in at the point when the (N —t) th box, empty before, receives one ball leaving 
t( < k) boxes empty. Let there be n, balls in the (N —t) boxes. Let the further number of balls dropped 








wit 


or 


Tn | 


or 


Let 


if q 








cularly 
80and 
st any 


uccess- 
r large 
erhaps 
lation, 
bles of 


ts and 
stribu- 
versity 


. Ann, 


. Acad, 


¥ series 


ber of 
mpart- 
where 
» is not 
n is, of 


let the 
en the 
1es the 
r there 
ym. our 


cess is 
ments. 


balls is 
eaving 
ropped 


Miscellanea 219 


up to and including the occasion when one further empty box receives one ball be ay_,. Then the total 
number of balls necessary to achieve N —k filled and k empty is 


N 
= D> aN-19 
t=k+1 
with % = 1. @y_; is a sequential binomial variable with the trials stopping when just one success is 
achieved. Accordingly 


Kin(%y-1) = (r—1)! ((2) a — 1) 





ith eas ie 
wi dak q= vy 
N-—-t\" 
my Kin(%y—) = (r—1)! (>) Pi — 1) ; 


In this classical scheme the «’s are mutually independent and consequently 


N —_ r 
Kipln) = (7 —1)1((W =H) (= 14+ ys (*=)). 


t=k+1\ ¢ 
K i eI il 
> ir(%) = (r—- ry( —k)(—1)"-1+ >» (25) ) 


(a form which leads more easily to asymptotic expression). 
Both the distribution and the factorial cumulants of the classical sequential set-up discussed in the 
preceding paragraph are well known. It is known also that for k not too large 


N n2 k 1 
Kyin) + Nloge 5, Kialn) mT . 3): 
r= 
n—logN 


When k = 0 the cumulants of r= W 


tend with increasing N to 


co 


1 
K, = y(Euler’s constant), K,= >} = (r > 2). 
1 


r 
This implies that in the limit K,= ( _ 2) log I'(z) 
Z 





z=1 


These cumulants are the cumulants of a variable 2 whose cumulative probability distribution function is 
exp (—exp(—2)) 
and this therefore is the limiting c.P.D.F. 


The normal limit follows in the sequential case as in the fixed sample size, classical type occupancy 
problem. 
Let k = N(1—p) and allow N to increase without limit. The mth factorial cumulant of n can be written 


N-k-1 (V/N)™(m—1)! 
Ki = (-1)""1 (N— -—1)! eee 
[m] ( 1) (N k) (m }4- oh (l- V/N)™ 


m N-k-1 v\i 
=(m=1)1 3 "O(-1 > (1-5) 
; V=0 N 


j=1 


N-k-1 V\-4 
Let T,= >» (1-5) ’ 


ifq=1—p. 


T, [P dx ss 
ats id 
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It follows that 

1 Py ae —Iyt 
and K,=N log 


As in the classical type problem this implies that 


n—N log(1/q) 
VN{(p/q) — log (1/q)}* 


is, asymptotically, a unit normal variable as N > oo. 





ROMANOVSKY’S CASE WITH RESTRICTED COMPARTMENT CAPACITY 


In this case, as we have described in our previous paper (Barton & David, 1959a), it is supposed that the 
capacity of each compartment is restricted to r balls. The probability distribution of n is, for k compart- 
ments, to be left empty, 

r(k+1) %O,,, N-k-1xo{m—-Dir} 
Nr—n+1 sis 9 ee j=0 


N-19, N-k-1={(m—-1)r} 1) ¥-k-1¢,, «N-2-1-0¢9 
= ——— — 1)\i N-k- =i 
Ne-10, imo ( ) j n—1 





p(n) = ( _ 1) N-k-1Q, AW-k-1-AC, 


a distribution which we believe is new. For the moments we proceed on similar, but not identical, lines 
to those for the classical sequential case so far considered. Suppose we enter the process at the point where 
t of the cells have been occupied, by S; balls, and that , balls have to be dropped between the occupation 
of the ¢th and the (¢+ 1)st cells. We have, conditional on S, (with conventionally S, = 0), that 

(rt — S,)™"—Y _  (rt#—8, "9 | (vt —S,"-Y 


P(m%) = (Nr—S,)*) r(N—t) = ~ (Nr— 8," (Nr—S,)-D" 


It follows, still conditional on S,, that 


é (os —+ a) = r(N —t) 
(Nr —S,+ 1) r(N —t)+m’ 


where Alm = (A+m—1)™ 








for any number A and integer m. For the overall expectation we have 


NG) pt+1 (Nr + 1) 


Pres 


& (Nr—S,41+ 1)! = 





t 
where Pots = T] (m+r(N -J)). 
j=0 
Reduction of this expectation gives us for the factorial advancing moment of S,, 


E(S™) = (Nr+ 1m Nort F MCAD! 
i=0 to 


n, the number of balls required to achieve just N —k occupied boxes, will be equal to Sy_,. We have 


‘ ” SS {k+(1/r)}! 
E(Sy-1) = 6(n) = (Nr+1)[ 1 {N +(1/r)}! ki ] 


2N! {k+(1/r)}! NM! {k+(2/r)}! 
d ‘ ” 
” E(n(n + 1)) (vr 1) r+ 2)/ 1 (N+(/}! kl iN+Qin}i fl |: 


where we use the notation x! = I'(~+1) for any x > 0. The higher factorial moments follow similarly. 
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APPARENT CONTAGION WITHIN A COMPARTMENT; A GENERALIZED POLY A SCHEME 


Following our previous paper (1959 a) if a is a measure of the contagion within a cell then the probability 
that (k—1) cells out of N will be left empty when (n— 1) balls are dropped randomly is 
NO,,, N-k-1 
4D (- 1) 9-#-10, wv-k-1-9 0-20, 
j=0 





aN +20) 


As we remarked there, this is a generalization of Pélya’s scheme. The probability that one further ball 
drops in an empty compartment is 
a(k +1) 
aN+n—1’ 
so that the probability distribution of n, the number of balls required to occupy (N — k) compartments, is 


N-10, N-k-1 
p(n) = weg, %, (—1)iN-F-1C, a-k-1-D+9-20), 


Themoments follow by arguments similar to those which we have used for the case immediately preceding. 
Alternatively, we note that formally we may write 


a=-r, (—A)™=(-—1)"A™, 


(Na+8,+n,—1)™\ _ (N—t)a_ 
(Na+8S,—1)™ ~ a(N—t)—m 





Thus é( 


conditional on S,. The overall expectation is 
Nt+Datt(Na— 1) 





E(NatSi4.—-1)™ = 


Pts ’ 
t 
where Putas = [] (aN -j)—m). 
j=0 
m ™C,( nies 1)#+™ 
Generally &(S™) = (Na—1)™ Nat ¥ ‘ 
i=0 Pit 


GENERALIZED SEQUENTIAL OCCUPANCY: UNEQUAL PROBABILITIES IN EACH BOX 


Weconsider here a multinomial type of sequential occupancy where there isno restriction as to box size but 
the probabilities for each box are not the same. Assume as before N boxes with probabilities 
Py» Po) +++» Pw Of the balls falling in them. The balls are thrown independently until (N —k) boxes have 
been occupied. 

(i) n fixed and k, the number of zeros, a random variable 


For this, the non-sequential case, we define a set of random variables « such that 


a,=1 if the zth box is empty after n balls are dropped, 


=0 ifnot. 
Then the number of empty boxes is 
k= > Oy 
i=1 
and E&(k™) = m! po (l—p,, —..--- 9)" 


1, <ig<...<im 
= m!S@\(say) (m> 1) 
with S® = 0. 
The probability generating function of k is 
N-1 
I(z)=1+  (z-1)™s 
m=1 
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(ii) k fixed and n a random variable 
Let P,(n) denote the cumulative probability distribution function of n. We have 


P,(n) = probability of at most k zeros after n throws 
= coefficient of z* in m(z)/(1—z). 





Write m*(y) = Up,(n)y", 
where p;(n) is the P.p.F. of n. We have 
m*(y) 
=P,(n)y" = es 
=F 
1 1 N-1 
= coefficient of z* in —— (+ + Dd (z- 1B a(y)} ’ 
1-z\l-y m=1 
h R,,(Y) x : 
where mY) = : : 
1,<i,<...<in 1-(1 an ee: yy 
*(y)—1 —- 
It follows that a = coefficient of z* in m4 (z—1)"" R,,(y). 
y-1 m= 
If further we put y = 1+, m(y)-1 & wy 
“ot = % Wor 


and therefore 


N-1 ee ee va 
atl = coefficient of z*in }) (z-1)""*) > [= (Pi, +--+ Pin] : 


vy m=1 i<...<tm (pi, +... +2:,,)" 





TWO APPLICATIONS OF THE PREVIOUS SECTION 

(i) Assume a line of unit length is broken, divided randomly into N pieces of lengths p,, p9, ..., py. If } 

Ym is the sum of m of these, then ; 
(N—1)! 

(m—1)!(N—m—1)!% 





P(Ym) = a -— 


If these lengths p,, pg, ..., Py are now the box probabilities then the Vth factorial moment of n, the number 
of balls required to occupy N —k boxes is given by j4y/V! which is the coefficient of z* in 


N—m)1 
= (z ae, 1)"-1 NC, m ar 


(N—1). 


(ii) Let the box probabilities bear a linear relationship one to the other so that 
Pi = 24(N(N+1)) (fj =1,2,...,N). 


Let us consider the mean number of balls necessary to ensure that every box is occupied. We have 
generally 1 
Pit +--+ Pig” 


May = (- 1)" 








where the inner sum is over all possible sets of m different p’s. For our particular case 


1 
N+1¢0 = ae | m—1 F — —= 
(%05) yy = x tee 
vt ‘ 1 . 1 
= i rahi dx } 
0 x 


which may be shown to tend to {(477/,/3) — 6}. Thus 


4n 
May ~ NHC, (5 a 6) . 
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This mean value is very much larger than that for the classical sequential occupancy scheme, where if 


te 
Pi ~ N 
we have My ~ NiogN. 


Ever since the early paper of Stevens (1937) the distribution of the number of zeros in the classical 
(De Moivre) case has been used in practice. Recently the Romanovsky type of problem has come to the 
front as, for example, where Turner & Eadie (1957) discussed the distribution of cells in haemacytometer 
counts when no overlapping of cells is permitted. So far we have not seen any applications of the 
sequential occupancy distributions other than in slightly unreal problems such as those connected with 
cigarette cards. There is no doubt, however, that sequential distributions are implicit in any collectors’ 
problem. For example, the compartments may be traps and the arrival of the insects (i) may be random, 
(ii) may be conditioned by whether there is room in the traps, or (iii) may be decided by the equivalent 
of a gregarious spirit among the insects. These three conditions will correspond respectively to the three 
cases we have discussed, namely, the classical, the Romanovsky and the generalized Pélya scheme. It is 
also possibly worth noting that the sequential aspect of the occupancy problem may be considered as the 
number of renewals in a special form of renewal process. 
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The generalized mean differences of the binomial and Poisson distributions 


By T. A. RAMASUBBAN 


London School of Economics and Political Science 


1. INTRODUCTION 
Gini’s mean difference g, defined by 


2 
x = |a,—-2,| (1-1) 


9=—— 
n(n—1) 4 jHi 


is one of the well-known and useful measures of dispersion. Unlike most of the quantities designed with 
a view to measuring the amount of scatter, g is independent of any central measure of location. But, 
owing to the mathematical complexities introduced by its definition, the study of the distribution of this 
statistic and in particular some of its sampling properties has not advanced quite as much as in the case 
of other scale measures, except perhaps when the vériates follow a normal law. 

For the normal population, the exact standard error of g had been first given by Nair (1936) by arather 
complicated method. Later Lomnicki (1952) obtained the same by a simpler derivation. Kamat (1953) 
evaluated the third moment in an exact form and, from the considerations of the measure of skewness /, 
conjectured that for large n the distribution of g may be that of a y. Following Kamat, I had obtained 
(1956) approximate values for its fourth moment and showed that the measure of kurtosis £, calcu- 
lated therefrom, taken together with the values of £, obtained by Kamat, seem to establish the closeness 
of the y-approximation, at least for sample size n > 10. I have also attempted to obtain empirical 
distributions of g for small samples (n < 10), the results of which I -.-opose to report at a later date. 

The normal distribution can be looked upon as a limiting case. ' .he binomial and Poisson distributions 
under certain conditions. It is therefore natural to investigate the sampling moments of g for these 
discrete distributions and to attempt fitting an appropriate distribution for g even if the exact distribu- 
tion is not easily found. In order to facilitate this work, the first step is to derive expressions for the 
absolute mean differences A, given by 


A, = X % |i-J|" pli) pl) (1-2) 
ij+i 
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for a few of the values of r, where i andj take all the integral values permitted by the discrete distribution 
p(t). In a recent article (1958), I have succeeded in obtaining values of A, for some of the discontinuous 
distributions; in particular, those for the binomial and the Poisson distributions are shown to be: 


n—1 (n—1 -1 aot) eh : 

A, (binomial) = 2npa| >> ( : * piig?n 2-24 = ey : pri-lg2n-2i-1 (1:3) 
i=0 4 i=1 a es 

and A,(Poisson) = 2Ae-?4[I,(2A) + I, 2A)], (1-4) 
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where I,,(x) is the nth order modified Bessel function of the first kind. In the present paper I shall 
evaluate for these two distributions the generalized expressions for A, valid for integral values of r. 


2. THE EVEN ORDER MEAN DIFFERENCES 
By definition, the even order mean difference is given by 
Ay = +; |i—J|*" p(t) p(9) = 2 (i—J)* p(i) (J). (2:1) 
v v 
Let & be the arithmetic mean and 1, be the kth moment about £. Then, since 4, = 0, 
mu 2r 2r 2r 
Ay, = =2 - {(i—£) — (9 — £)}" p(t) p(J) = Mar + 2 | Her-2fa—\ 9 Par-sba tt 5, 9 )MaMar-2t Mar 
2r—2 
at 2 for + >, = 1) (" ‘) Pear — f4;- (2:2) 


It is thus possible to express the mean difference of even order in terms of the moments of the distribu- 
tion. In particular, 


A, = 2g, 
Ay = 24 +3/3), (2:3) 
Ag = 2(4g+ 154 42— 102), and soon 


On substituting the various values for the moments of the binomial and the Poisson distributions in 
(2-2) or (2-3), the corresponding even order mean differences can be evaluated. 


3. THE ODD ORDER MEAN DIFFERENCES FOR THE BINOMIAL DISTRIBUTION 


The evaluation of the odd order mean differences for the binomial distribution calls for some interesting 
algebraic manipulations. We have 


ee n\ [n\ . : _ 
Arn = DY D Jat ( ) ( ) piqr-‘p qr (3-1) 
i=0 j=0 7 NZ 
and since the sum of (¢—7)?"+1 over the distribution vanishes, (3-1) becomes 
n i a 
Arn =2 0 D G94 ( ) ( ) pq" ‘pq" (3:2) 
i=0 j=0 t}\9 
n\ , er n 
=32 > ()ea{ >» =a ( ‘ ens 
i=0 \t% j=0 Jj 
SM . 3 n . 
= ey ; piqr-* q2rtl q"™+(i—1)?"+1 Py a ee p i—lgn —i+l (3-3) 
=@ \% 0 r 2a 
Expanding the sum in (3-3) and rearranging the terms to form a finite series in p*q?2"-* (s = 1, 2,..., 2n—1) 
we have 
A 2 oe : 2 2r+1 " " 2i+1,2n—2i-1 
= j +. )2r+ 4 5 ic + n—2i— 
i 2, (2 dl (.",) ( +j+ i} 4 


n 
+ (2 part ‘ ) (, )) omar» | “ (3-4) 
= z ? —j] \t+) 
The method of evaluation of the sums 


ae . n n * n n 
Zoerun(" ) (jaa) = Roene(" i) (cts) 











Sp 


Oy 


Su 





(2-1) 


Loy 
(2-2) 


ribu- 


(2-3) 


ms in 


sting 


(3:1) 


(3-2) 


(3-3) 


1—1) 


(3-4) 
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is somewhat involved and lengthy. I shall therefore omit such of the algebraical details which may not 
impair its clarity. 


i n n 
Consider the sum (29)2r+2 (, ) (, ) : 
Py J t—J a+) 
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i-k / n—k n—k 
t = 2j+k 
. a (75-4) (ia5) 
n—k n—k 
d = 27 +k)! ti+k = D'(S,), 
an ox. = zeit A." athe Ree (S,) 


where the operator D = ¢(0/ét). The sum required is therefore 09, 241 |,-1 = D+ So|,-1; and since the 
expanded form of D?"+1S, has DS,( = o>,;) as a factor, it is more convenient to operate 2r times on Oo, 


and then set ¢ = 1. Now 
n 
= 3, 3°5 
Fo1 = P ( 2(, oa te vit 


Splitting 27 as {(¢ +7) —(*—J)}, using Vandermonde’s theorem, and finally summing over J, (3-5) gives 


ves ( Da) RO) (as) - 


On putting ¢ = 1 in (3-6), we have the well-known result 


3 l n—1\ (n—-1 

=i — 1 s 7 . 
0,1|t=1 rf ra 
Again, 


| 1 -1 1 
ran = Dera 9[ (7) (24) ore (54) (8) olor] 


(3-7) 


It can readily be seen that any even number of operations by D on (¢—¢-') vanishes after ¢ is put equal to 
unity and that any odd number of operations yields a factor 2. Therefore, expanding the term 
D*"{(t — ¢-1) /+4} on the extreme right of (3-7), by Leibniz’s theorem and letting t = 1, we have 


D* X(t ex t-1) +1} | =2 (7) Dtr-1 4. “ Dr-3 + 1+ 2r ) prol g2i+1 
3 r—l “1 


=2 s ( 2r 1) (+ 1)2*-271+1 (3-8) 
p,=1 2p, — 
(3-7) can therefore be written as 








n—1 eal :) : ( 2r ) 
Oo, =n. é 227+ 2n D*-2n41 8) (3-9) 
aes ( be ) \e—1 po 2p,—1 “l= 
Now DS, = S (27+ V(, ay :) fe ’) p2it1 
, = 4 i-—j- t+j . 


Splitting (27+ 1) as {(¢+j) —(¢—j —1)} and summing as above we find, 


n—2\ (n—2\ , 1\ t=? / n-2 n—2\ 
ps, = (m0) ("5") (72) #+ (3) 3 (25-2) (5) = 


Operating on (3-10), (27 — 2p,) times Tr as before and letting ¢ = 1, we may show that 











= r=P, (2r—2 
pw-tn+1g, = (n—1)("—7) ("—?) ger-an 4 a¢n—1) Se (72) por-ani-aortig, (3-11) 
a w~— p.=1 2p. -1 t=1 
Substitution of (3-11) in (3-9) and simplification yields, 
n—1\ (n-1 n—2\ (n-—2 
cet econ | a ) (i21) ran ( a )("23) 
* TP 2r 2r— 2p, 
+22, ( ) ( ) De-sn-anssgs » (3°12) 
os ma 2p,—1) \ 2p,-1 . t=1 


15 Biom. 46 
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r+ 


where Gy,= 2" and a= 3.4 





(29+1 ae 2) 


and n® = n(n—1)(n—2)...(n—8+1). 
Dealing with (3-12) in exactly the same manner as with (3-9) whose forms are identical, we finally have 





r+1 n—s\ [n—8 
= (8) . 
Fo, or+1 bi = AygN ( i ) Ra ’ (3-13) 
2 
r— Pr s—2 1 
Re hm 2 2r—2 2r— 2 2r— > 2p 
where a,,= 21 >) > Face ( id )( A “an : >>) Pa (s+1) -_ (314) 
P,=1P2=1 Me-,=1 2p,—1}) \ 2p,-1 2p,.-1 


It will be evident from (3-14) that the series (3-13) must terminate at s = r+1 since, for values of s 
greater than this, the last binomial coefficient occurring in (3-14) will vanish, even for the minimum 
value of the p,, namely unity. 

The evaluation of a,, in (3-14) is not as difficult as it appears to be. The successive summations, starting 
with respect to p,_;, ultimately give 


Q2r+1 s—1 2s—1 2s—1 
= —j]) pe _ 2r+1, . 
oe * e+1)...(80) te” ( m ) (m=1)}° ™ i: 
i 
The procedure being the same for effecting the other sum, )) (27+ yen (,* ) (, ), T shall 
j=0 4—j] \tt+jt+1 
simply state the final result: 
U n n rt+i n—s\({ n—8 
27 + 1)2r+1 = 2 mi) ‘ 3-1 
Bortnr ("ajar = (5) (te) i: 
1 s 2s 28 
h . ~6* —1)™ - és ar, ‘17 
where Gs, o+1 (e+ 1) 22s (28) oro | ) (rr) (,,-1)} 2m +1) (3-17) 


It may be pointed out here that there appears to be more than one method of evaluating these sums 
and that each method provides series similar to (3-13) and (3-16). However, these different series are only 
variations of the ones given here with the coefficients a,, and a7, modified. It also seems possible to 
obtain a few relations concerning these coefficients but they are of only algebraic interest. The only 
relation which I shall make use of at a later stage is 

Oy 41 = Ap e4, = 27! (3-18) 


On substituting (3-13) and (3-16) in (3-4), the mean difference becomes 


nm—-1 (r+1 n-8s n-s n—-1 (r+1 n-8s n-8 
A = 2 KO) : : 21+192n—2i-1 (3) : : 2ig2n—2i | 
ais [= (3 ann ( v \(neea)}e , +E [Zann ( v \ir3)}° . ] 
(3-19) 


It can be verified that on putting r = 0 in (3-19), the value of A, given by (1-3) is readily obtained. 
(3-19) can be modified to give an alternative form for A,,,, in terms of the hypergeometric function 


(a, 8; 3x), where 
Fila Bs a(% +1) B(B+1) 2? 
yt a 
Taking account of the fact that the limits for 7 in (3-19) are to be taken such that none of the binomial 
coefficients like (";’) vanish, we find 


F(a, 2; y; 2) = 1+ 


Op 4 
i 


r+1 n-8 (n—8 n—s 
A =2 ? wl9p8q* 2i—s+1,2n—2i—s—1 
i 4 {as = poy ( a _ Bee 1)? . 


+a,.nptg? > (" si ‘) (‘ 4 ‘) pened : (3-20) 


i=s 


7 t—8 
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It is then not difficult to show that the sums in the braces on the right of (3-20) are respectively equal to 


Ea (pq)? .F',( —n + 28— 1, 4(28— 1); 2s—1; 4pq) 


and (";’) (p9)* sF's( —n + 28, (28 + 1); 28 + 1; 49), 


from the fact that these sums are the coefficients of 1/t*-1 and 1/t* in {(q+ pt) (¢+p/t)}"—, i.e. in 





(1-t)? n-8s i 
1+ ; pq) , sinceeg+p=1. 


Thus, 
r+1 n-—-s 
Asra1 = 2 x {azn (* ‘) p**tq**-1 FP (—n + 28— 1, $(28— 1); 28—1; 49) 
que 


n—8 
+a,,n'9( ) pF —n+ 28, 3(28+1); 28+1; 40) - (3-21) 


The following tables which will be useful in writing down explicitly the higher odd mean differences 
from either (3-19) or (3°21) show the numerical values of the coefficients a/, and a,, for r = 0(1)5; 
l<s<r+l. 

Table 1. Values of aj, 












































8 
1 2 3 4 5 6 
Pa 
0 1 
1 1 4 : 
2 1 40 32 , 
3 1 364 1,120 384 ‘ 
4 1 3,280 30,912 32,256 6,144 , 
5 1 29,524 799,040 1,951,488 1,013,760 122,880 
Table 2. Vaiues of a,,/2?" 
8 
1 2 3 4 5 6 
r 
0 1 : 
1 1 1 
2 1 5 2 
3 1 21 28 6 : 
4 1 85 294 180 24 ; 
5 1 341 2,816 3,762 1,320 120 





























4. THE ODD ORDER MEAN DIFFERENCES FOR THE POISSON DISTRIBUTION 


The odd order mean difference A,,,, for the Poisson distribution is given by 


o o ae Ai Aj 

Agi =e" YY pF" — 7 
i=0j=0 oy 
o 4 At Ai 

=2-A DY DY (i-jyrH- — (4:1) 
i=0j=0 a! g! 


for the same reason as for the binomial distribution. 
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The sums in (4-1) may be obtained in a straightforward manner; but this becomes quite tedious for 
r > 2. Ihave therefore considered the alternative simpler approach which is to obtain the limit of (3-21) 
for the binomial distribution as n > 00, p > 0 and np >A. 
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Since lim ,F\(—n+a,f; y;4pq) = 1F\(f; y; — 4A), (3-21) under these limiting conditions becomes 


n>, p>0 


2s— 


Aorsa = =2 = ars 351i py 


1F',(4(2s—1); 2s—1; = 40) +45 (Bayt (28 + 1); 28+1; - 4}. (42) 


Also, by virtue of the relation 
T+) 1F,(4(2 + 1); 2v+ 1; — 4A) = e-®A J (2A), (4:3) 


where the function J, has been explained earlier, (4-2) becomes 
i 
Aorsa = 2e-2A »y A*{ay,T,-4(2A) - ay, ,(2A)}. (4:4) 
s= 


It will be seen that the value of A, given by (1-4) agrees with the above, on letting r = 0; and 


= 2Ae-*A{(1 + 4A) 1, +4A],}, 


A, = 2Ae-A{(1 + 16A + 32A2) J, + 8A(1+4A) I}, (#8) 


after successive reduction of I,(v > 2) to I) and J, by the recurrence relation 
Ty4,(2A) = I,_4(2A) — (v/A) I,(2A). (4:6) 


In (4-5), I, should be taken to mean J,(2A). These values have also been checked independently by 
evaluating them directly from (4-1). 
It is of some interest to consider the standardized ratio A,,,,/(variance)"++, namely, 


Qe-2A r+ 
Dory. = Vrs z As {a;,I 8— _1(2A) +a,,I,(2A)}. (4:7) 


A limiting form for (4-7) can be got for large A by considering the asymptotic series for the modified 
Bessel function J,(2A). This is given by 


A= 19 (A— 1) (4-H) 0 2 
+ (=). 7 (4:8) 


Aa & is —{1- 1! 8x 21(82)? 





This serves all practical purposes so long as v is not of order ,/x (Lehmer, 1943). Considering only the first 
term in (4-8), the limiting value of D,,,, for large A can be written as 


——_— r+1 


Den = Tr Py A’ on JA oii 


—==— ay (Gre + Ars), 


which on simplification and omission of terms of order A-!, A-*, etc. gives us 


1 ’ 
Do 41. ~ Jar Ares + Greta) (4:9) 
Substituting for the numerator from (3-18), 
2 
Doss & lille (4-10) 
When r = 0, the limiting value of D, equals 2/,/7, as demonstrated in one of the tables in my recent 
article (1958). 
5. CONCLUSION 


I may mention that although explicit results have been obtained here, it seems pc.» ible to derive 
certain interesting recurrence relations connecting the mean differences of different orders by considering 
the absolute moments of the distributions of the variate differences. This work is being pursued at the 
moment and I think I shall soon be able to record the outcome of this approach. 
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Finally, I wish to express my indebtedness to Prof. M. G. Kendall, under whose supervision the above 
investigations were carried out, for his continued support and encouragement. 
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Determination of parameters in the Johnson system of probability distributions 


By D. C. M. LESLIE 
Royal Aircraft Establishment, Farnborough 


The system of curves proposed by Johnson (1949) for the graduation of statistical distribution has been 
very successful in practice. The principal drawback is that it is not very easy to determine the four 
parameters defining the distribution from the observed moments. In this note, a method is suggested for 
calculating these parameters if the distribution under study is not far removed from normality. For 
a short summary of the Johnson system, the reader is referred to Draper (1952). 

The Johnson system of curves is mainly used for fitting to empirical data, but it can also be used to 
graduate theoretical distributions. In the author’s researches, the generating function of a distribution 
was obtained in closed form, but the inversion integral could not be evaluated. The first four moments 
could be found very easily, and this suggested the use of a system of frequency curves to fit the distribu- 
tion approximately. It was found that the distribution was never very far from normality, and that it 
gave rise to /,, 8, points which always lay in the S, region of the /,, £, plane. Therefore, this note deals 
only with the fitting of curves of the S, family to distributions which are not too non-normal. 

The variable x has an S, distribution if 


z=7+0sinh-} (=). (1) 


z being a unit normal variable.* The problem is to determine 9, 5, § and A given the first four moments 
#, of an observed distribution (this term including distributions which arise theoretically). From the 
opposite point of view, it is comparatively easy to calculate the yu, given 7, 5, and A. Formulae are given 
by Johnson (1949, p. 163), and from these formulae it follows that 


{o( + 2) sinh 83Q + 3 sinh Q}? 


2 
2(w cosh 2Q + 1) (2) 


A, = o(w-1 





w(w + 8w? + 6w + 6) cosh 40 + 4u(w + 3) cosh 2Q — 3(w 7, 
2(w cosh 2Q + 1)? : 


where wo =e" and Q=7/6. (4) 


and Yo = f,-3 = (w—-1) (3) 





The problem is now reduced to that of determining w and Q from given values of /, and y,; the func- 
tional form of equations (2) and (3) makes it clear that the problem is rather formidable. 

However, it can be solved completely if the distribution is symmetrical about the origin, since then 
£, = 0, but y, + 0. This implies Q = 0, so that equation (3) reduces to 


Yo = $(w*— 1) (w*? +3) 
and w = {J(4+ 27) — 1}t = {¥(28,— 2) — I. (5) 


* The letter 7 has been used in place of Johnson’s y because of the use of y, for the standardized 
fourth cumulant. 
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This determines 6 directly, while Q = 0 implies that 7 = 0 also. The remaining parameters £ and A are 
determined from the first two moments of x. Johnson’s formulae are for the moments of the normalized 
variable 
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_2-§ 
adele 
and transforming them, we find fw, = §—Aotsinh Q, (6) 
fz = $A%(W— 1) (w cosh 2041). (7) 


Since the distribution is symmetric, “7j = 0, while it has been proved that Q = 0; thus = 0 also, while 


2Ms 
A= S 
J oak (8) 
w being given by (5). 


When /, + 0, the problem does not seem to be soluble in terms of recognized functions. However, 
equations (2) and (3) show that if £2, = y, = 0 (i.e. if the distribution is normal) then w = 1. This suggests 
that if #, and y, are small, an expansion of w — 1 in powers of f, and y, may be useful; she existence of 
such an expansion follows from the analytical nature of the expressions (2) and (3). To simplify the work, 
we put 








m = wsinh?Q (9) 
which reduces (2) and (3) to the purely algebraic forms 
- m[4(w + 2) m+ 3(w+ 1)?}? 
A= en Dg (10) 
_ (o-1) Po) 
2 2(2m + + 1)?’ (11) 
where 
P(w) = 8(w* + 8? + 6w + 6) m? + 8(w4 + 30 + 6? + Tw + 3) m+ (w5 + But + 6 + 10W? + 9w + 3). 
Expanding equations (10) and (11) about the point w = 1, we find 
9m 
= —— (w— — 1)’, 2 
Ay = (0-1) +0(-1) (12) 
4(4m +1) ; 
ae = wai 13 
2 ei (w—1)+O0(w—1)?, (13) 
(12) and (13) may be inverted to give 
w = 1-46, +}72.+ O(fi, ete.), (14) 
42, 
m= ——"!__ +. 0(B,, Ys)- (15) 
97, - 16, Bi Ye 


Equation (14) in particular is attractive in its simplicity, and provided /, and y, are small, this pair of 
equations enables 7 and d to be determined very rapidly. It should be noted that £, and y, must be known 
fairly accurately if good values are to be obtained for 9 and 0. 

If £, and y, are not small enough for (14) and (15) to give good results, adequate accuracy can some- 
times be obtained by using more terms of these expansions. The process outlined above has, therefore, 
been extended to include terms of order (w— 1), and it is then found that 





v= 1—$2, + 472— Fah + 443A 72—- Levi + O(f3), (16) 
4p, (27y3 — 648, 7, + 4083) 2, 

= O q 17 

~ 972- 162," 6(97_—16f,)? +O) is 


If these expansicns do not give adequate accuracy, they will at least provide useful starting values for 
a process of solving equations (10) and (11) by successive approximations; a considerable amount of 
labour would be needed to take them to the third order. Once 9 and é have been found, £ and A may be 
determined from equations (6) and (7), which should be used in the forms 

Mi = £—Ami, (18) 


Pg = 4A2(2m+0+1). (19) 
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It should be mentioned that Draper (1952) has solved the problem of inverting equations (2) and (3) 
heuristically. He has drawn extensive abacs of /, and y, as functions of w and Q, and has then sought to 
fit empirical curves to these abacs. For w he finds a power series not dissimilar to equation (16); he gives 


w@ = 1—0-312f, + 0-227y, — 0-047? + 0-069/, y2— 0-025y2 + 0(f3), 
while (16) is equivalent to 
w@ = 1—0-333f, + 0-250y, — 0-096? + 0-1538,y. — 0-063y2 + O( 3). 


The coefficients of the first-order terms agree quite well, and those of the second-order terms have at 
least got the same signs. There is no very obvious correspondence between equation (17) and the various 
formulae given by Draper for 2. 

Dr Johnson has suggested a simple but instructive test of these formulae. A pair of values of w and Q is 
selected, and the corresponding values of /, and y, calculated from equations (2) and (3); w and Q can 
then be estimated using the formulae given above, and the estimated values compared with the exact 
ones. Values obtained from equations (14) and (15) will be denoted by (@,, Q,) (first-order estimates) 
while those obtained from equations (16) and (17) will be denoted by (w., Q,) (second-order estimates). 

The table below shows the sort of results which are found when (w— 1) is small 


w= B= pips oO, = = W, = —— 


Q=O1f y,=0-4560f 0,=0-097f OQ, =0-1001 
@=11) f£,=0-2182) o,=1112) = 1-0979 
Q= ant Y.= rien a, = oan Q, = amit 
o= in| f, = 0-5758\  @, = 1-115) w, = 1-0969) 
Q=10f y= anal Q, = a Q, = 0-9985) 
o= a By = et @, = 1-405) w, = 1-2401 
Q=O01f y,=1-6744f OQ, = pth Q, = meet 


As long as y, is not too large, the second-order formulae seem to give good results. Equation (5) shows 
that a series expansion in powers of y, must diverge if y, is greater than 2, and this implies that the 
method suggested above will only work well if y, < 1. There must also be some limit on /,. Equation (5) 
is, however, valid for all values of y, as long as £, = 0. This suggests that an expansion of the form 


@ = foo) + Ai filY2) + Bi Sa(Y2) + --- 
might be very useful. It is already known that 
Sol¥a) = {V(44 272) — 1 
and the next term should not be too difficult to calculate. 
The author is indebted to Dr G. M. Jenkins for drawing his attention to the problem and for giving 
much helpful advice on how to solve it, and to Dr N. L. Johnson for suggesting the test of accuracy given 
above. Acknowledgment is made to the Controller, H.M. Stationery Office, for permission to publish this 


note. 
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Note on a problem of estimation 


By D. E. LLOYD 
Ordnance Board, Ministry of Supply 


INTRODUCTION 


1. An estimation problem has arisen in which a random variable R from an unknown distribution with 
frequency function p(7) has a probability of being observable which is a function of r denoted by F(r). 
Thus the information available from an experiment consists of a set of observed values 1,19, --++7 ms 











232 


together with the number (n — m) of unobserved values. Truncated distributions are a special case which 
is frequently met in practice. However, in this note a case with a continuous function for F(r) is 
considered. 
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2. In the examples considered, the information is used to estimate a parameter of the distribution 
function p(r), F(r) being assumed known. However, a similar method could be used to estimate para- 
meters of F(r). Estimates based on all the available information are compared with those based on 
115199 +++» 1m Only, and with those based on the ratio m/n. 


3. The chance of an observed value r is p(r) F(r). Thus, if a single value of R is chosen at random, the 
chance that it will be observable is 


P= Jom F(r)dr (1) 

and the chance that it is not observable is (1—P), the integral being taken over the whole range of r. 

4. If a sample of size n is taken from the population, the probability of the observed values being 
11519 +++ 1m and there being (n —m) unobserved values is 


m 
"Cm i {p(r;) F(r;) dry (1—P)"-™. 
The log likelihood function is 


m ™m 
L = log"C,+ & logp(r;)+ & log F(r;) +(n—m) log (1—P). (2) 
i=1 i=1 
If 6 is the parameter (or one of the parameters) of p(7) to be estimated 
oL m 0 n—m OP 
— ssi A eels ay ca 
80 = 2, a6 UEP") — Tp aH (3) 


is the maximum likelihood equation for 6. 


ESTIMATE BASED SOLELY ON NUMBER OF OBSERVED VALUES 
5. In a sample of size n, the probability of obtaining exactly m observed values is 
"C,,P™(1—P)"-™. 
The log likelihood function ZL = m log P + (n—™m) log (1—P) so that the maximum likelihood equation is 
al _maP_n—méP _, | 
006 P 0 1-P20 ” 
therefore P(6) = ~ (4) 


gives the required estimate. 


ESTIMATE BASED SOLELY ON 1, 1g; «++» 7m 


6. Given that m realizations of R are recorded, the probability that the values 7, 7g, ..., 1m Will result is 


Pr {1,72 «++» 7m and (n —m) unrecorded values} 
Pr {m recorded and (n—m) unrecorded values}” 








m 
Tt {p(r;) F(r;) dr (1—P)"-™ 
_ = 





P™1—P).-™ , 
m ™m 
therefore L= > logp(r;)+ > log F(r,) —mlog P. 
i=1 i=1 
ob ma m 0P 
Th —~ 2 os ae ees td 
“4 00 % 00 log P(r) P 20 : (5) 


gives the required estimate. 
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SPECIFIC FUNCTION FOR 7(7). 


7. Now, put 
ay 


a 
T'(3v) 





pr) = riv-le-ar (O<r<o). 


This represents a y? distribution with v degrees of freedom and unknown dispersion. 
Then, log p(r) = 4vloga + (4v— 1) logr—ar—logI'(3»), 





h 7) 1 v 
—- =—-"?. 
ence = og p(r) Ox 
Substituting in equation (3), we find 
m _ 
es r; Py De oP ae (6) 
2 on 1—P da 
1 ™ _ 
Put A=—¥rm% B= (7) 
™m i=1 m 
Then equation (6) becomes 
v B oP 
ees 8 
= 2a* 1—P da (8) 
Thus A and B are jointly sufficient statistics for the estimation of «. 
Equations (4) and (5) give 
P(a) =~ (9) 
n 
vy 10eP 
d A-—+——=0 10 
- 2a * P ba a) 


for the other estimators of a. 


SPECIFIC FUNCTION FOR Fr) 


8. The function F(r) must be chosen, as a result of prior information, to describe the conditions of the 
experiment. When truncation is assumed a function is chosen in the form 


F(r)=1 (r<7), 
=0 (r>*7p). 


However, problems may arise in which, as a result of previous experiments, it seems more reasonable to 
use a continuous function for F(r). We consider the case where 


F(r) = exp(—7/A), 
where J is a constant, the value of which, it is assumed, is known. 


9. For the particular functions chosen 


P= [ere dr 
0 


ar [ 
= ma! phv—l e{atlA)}r dy 
T(r) Jo 





J (+z) ”. (11) 
ar 
Hence — = = 4 Ti (12) 
2a(ar + f(a +3) -1| 
and 1 eP _ v (13) 


Pax 2a(aA+1)" 
Equations (12) and (13) can be used to substitute for P in equations (8) and (10), respectively. 
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THE CASE vy = 2 


10. This is the case where r is the squared radial distance of a point distributed in two dimensions in 


circular normal form. 
Equations (11), (12) and (13) give 


P “ht 
ee eS a 
Pm at TOA 
1eP 1 
d = — A). 
an P 0a ti +aa) 


Using equation (15) to substitute for P in equation (8) gives 


Aat+ (5-148) 0-5 = @. 


The positive root of this equation gives the maximum likelihood estimate of a, denoted by &y,. 


11. Using equation (14) to substitute for P in equation (9) gives 
1 n 
1+—=— 

a ar 
therefore a= — 
We denote this estimate of « by &, 

12. Using equation (16) to substitute into equation (10) gives 
.§ 

A——+-—(1+aA)+=0. 
a 


_A-A 
~ 


Hence a 


We denote this estimate of « by &, 


VARIANCES AND EFFICIENCIES OF ESTIMATES 


13. For large n, the asymptotic variances of the three estimates are found to be 


2 
var (yz) = —(P— P+ P2)-, 
A a? 
var (%,) = —(P—P?)-}, 
n 


A a? 
var (a,) = —P-3, 
n 


(14) 


(15) 


(16) 


(17) 


(18) 


(19) 


(20) 


(21) 


(22) 


If we measure ‘efficiency’ in terms of inverse variance and regard a, as being 100% efficient, Fig. 1 
shows how the large sample efficiencies of 2, and &, vary with P. &, is more efficient when P is large, 


&, when P is small, as might be expected. The sum of the two efficiencies is always 100 %. 


OTHER VALUES OF V 


14. For a value of v + 2 the equation corresponding to equation (17) will not reduce to a quadratic 
equation in «. In these cases it is sometimes convenient to construct a chart plotting A/A against B for 
fixed values of «A. From equations (8) and (12) it is evident that the graphs are all straight lines, and 


approximate values of 2, can easily be found using the chart. 


15. In conclusion I wish to thank Mr D. J. Bishop for advice and encouragement. 
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Fig. 1. Comparison of efficiencies. 


On the non-central chi-square distribution 


By MUNUSWAMY SANKARAN 
Presidency College, Madras 


1. Abdel-Aty (1954) has shown how the transformation 


y= (5) = (ZY. where r=f+A (1) 





may be used to obtain an approximation to the distribution of non-central y?, where f is the number of 
degrees of freedom, A the non-central parameter and h an appropriate positive constant. To determine h, 
Aty examines the cumulants of y expressed in terms of cumulants of y”*, as power series inr~*. He finds 
‘after expansion that h = } is the appropriate value to choose for minimizing the coefficient of r-? in 
k,(y) and reducing the higher cumulants, «,(y) for s > 2, to aminimum’. He then develops two methods 
of approximation. 

(i) This assumes that (y’2/r)t is normally distributed about 1—3(1+6)/r with variance $(1+6)/r, 
where b = A/(f+A). 

(ii) Alternatively, he suggests a ‘closer approximation’ which consists in applying the Cornish—Fisher 
(1937) expansion to the standardized deviate, 


y — Ky(y) 
= ____——, 2 
J{Ke(y)} @) 


where / is again taken as }. 


2. In the present paper we shall use Aty’s transformation (1) but instead of setting a fixed value to h, 
namely, h = } here, we shall give h changing values so determined that the leading term in the third 
cumulant of y vanishes, thus following the procedure adopted by Wilson & Hilferty (1931). It follows 


that 
kyky _ 2(f+A)(f+3A) 


[Oe (f+ 2A)? 








(3) 


k, = 2*-(s—1)!(f+8A) (4) 
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is the sth cumulant of y’?. It will be seen from (3) that 4 < h < 4. We have for the first four cumulants 
of y, for the value of h given by (3), 
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. 4) #2 —~pa—21—3) = 
k,(y) = 1+A(h I) 5a th 1) (h—2) (1 3h) Sys 
[2k2k, —(28— 51h + 11h2) ke] 1 
+ h(h—1) (h—2) (h—3) aie +0(5). 
k ke 
kaly) = hte, +hMh—1)(1— 3h) 
[(7h— 11) kk, — 2(h— 2) (35h? — 84h + 40) k3] 1 
li th 12K8 +0(7) tr 8) 
[2(23 — 49h + 23h2) k3— 3kik,] 1 
Kg(y) = h%(1—h) a “I40(5). 
my 3k, k,—4(4—5h) kek) +0(4 
Kay) = spl 1k, — 4(4— 5h) kgkg]+ (<). 
K =O . 
5(Y) = (5) +--- 





3. Two approximations will now be considered. 
(iii) First approximation. We take y as normally distributed with the following mean and standard 
deviation : 








2 ke k3 
&(y) = 3 +0 —Tag - aR -N~ , 
_ hk} (1—h) (1—3h) 


It should be noted that this approximation is similar to that given by Haldane (1937, p. 398) in his paper 
‘The approximate normalization of a class of frequency distributions’. We shall describe this as approxi- 
mation H. 

(iv) Second approximation.* We shall in this case apply the Cornish—Fisher form of the Edgeworth 
expansion to the Y of equation (2), where h is as before given by (3) and the cumulants of y are obtained 
from (5), using the k, of (4). It follows that considering terms up to order r-?f, the 100« percentage point 
of the standardized deviate Y is given by 


[2(23 — 49h + 23h2) k3 — 3k2k,] 


[3k ky —4(4— 5h) kak] 
aki or 


ey 3,(€2-1)(1-—h = 
a= Eat A(E-1) (1-2) — 





= 72(E%— 364) 





where £, is the 100« percent point of a standardized normal deviate. 


4. Some comparisons of approximations to the upper and lower 5 % points are made in Table 1 below 
for the same f and A values used by Aty. It is seen that at the upper 5 % point the Edgeworth approxima- 
tion (iv) of this paper, based on a varying h, is definitely more accurate than Aty’s similar approximation 
(ii) with h = 4. Further, the simpler approximation H, or (iii), is here somewhat better than Aty’s 
Edgeworth approximation, and a great deal better than his simple normal approximation defined in (i) 
above (but not given in the table). At the lower 5 % point both Edgeworth approximations are good, 
but Aty’s is somewhat the more accurate. The H approximation is not so good here, and is not shown in 
the table. 

5. It is difficult to draw any general conclusions because exact values for other percentage points are 
not available for comparison, and it is by no means certain that an approximation which is best at one 
percentage point will also be so at another. The present investigation has, however, shown that under 
some conditions approximations based on a fixed value of h =} will not be the best to use. 


* I owe this suggestion to Dr F. N. David. 

+ Strictly this includes also the term 3}5k,(y) k.(y)-4(£4 — 6£3 + 3). It is felt that omission of this as 
well as terms of O(r-*) in k,, k., ks and k, will not affect the conclusions reached here. The inclusion of 
these terms will only strengthen the conclusions, but will also considerably increase the computations 
involved. 
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Table 1. Comparison of exact percentage points of the x’* distribution with the values obtained 
fron various approximations 
































Upper 5% points Lower 5% points 
. | | | 
| | |Edgeworth| Edgeworth 
| Aty’s | expansion Aty’s | expansion 
P 3 A | Exact ‘closer | Approx. | to the Exact ‘closer to the 
| approx.’ H | present approx.’ present 
| | approx. approx. 
hi ad ae Ros 2 ot ek eat ost ore 
2 1 | 8-642 | 8-38 8°58 8-656 0-168 0-171 0-157 
| 4 | 14641 | 14-62 | 14-63 14-661 0-646 0-643 0-654 
16 33-054 | 33-08 33-07 33-060 6-322 6-320 6-331 
25 45308 | 45:33 45:31 | 45-317 12-080 12-077 12-085 
4 1 11-707 11-67 11-69 | 11-681 0-909 0-908 0-918 
+ 17-309 17-27 17-28 17-318 1-765 1-766 1-763 
16 35-427 35-44 35-43 35-435 7-884 7-885 7-893 
25 47-613 47-62 47-62 47-621 13-733 13-732 13-737 
| 
ae 16-004 15-99 15-98 16-013 2-494 2-494 2-497 
+ 21-228 21-21 21-20 21-242 3-664 3-665 3-668 
16 38-970 38-96 38-96 38-978 10-257 10-256 10-264 
25 51-061 51-06 51-06 51-068 16-226 16-227 16-231 









































My thanks are due to Dr F.. N. David for her helpful criticism of an earlier version of the paper. I also 
had the benefit of helpful suggestions of Prof. E. 8. Pearson in the preparation of the paper for publica- 
tion. Finally, I wish to record my appreciation to some of my students for computational work in 
connexion with the table. 
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On the distribution of the largest of six roots of a matrix in multivariate analysis 


By K. C. SREEDHARAN PILLAI* anp CELIA G. BANTEGUI+ 
The Statistical Center, University of the Philippines 


1. INTRODUCTION 


Roy (1945, 1953, 1957) has shown that tests of certain hypotheses and confidence interval estimation in 
multivariate situations can be based on those associated with the distribution of the extreme charac- 
teristic roots of a matrix whose elements are functions of the observations. The distribution of the extreme 
roots depends on the number of non-null roots, s, and on two other supplementary parameters, m and n, 
which are functions of the number of variates and, in some cases, the number of samples and the size of 
the samples. 


* United Nations Senior Adviser in Mathematical Statistics and Visiting Professor of Statistics. 
t Research Fellow, 1957-58, and presently Lecturer in Statistics. 
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Three different types of hypotheses are often posed for multivariate tests and the non-null charac- 
teristic roots of the matrix that arise in each test have a distribution, the form of which, under the null 
hypothesis, is the same for all the three tests. Roy (1939), Hsu (1939) and Fisher (1939) derived = 
pendently the distribution of the roots, 0,,...,0,, which can be given in the form 


Miscellanea 











S(9;, .++9 5) = Otem,n) TT Or(1—0,)" i (0,—9;) (0 < A, oS 0, < 1), (1) 
=] i>j 
a i (meee) 
= i=1 
whess Cam 9 Im+i+1\.(n+itl\—/A\° (2) 
fe) 
j= 2 2 2 


and the parameters m and n are defined differently for the different types of hypotheses (Pillai, 1955). 
In this paper, the cumulative distribution function of the largest of six roots has been studied with 
a view to tabulating the upper percentage points. 


2. AN APPROXIMATION TO THE C.D.F. OF THE LARGEST OF SIX ROOTS OF A MATRIX 


Pillai (1954) gave the explicit expression of the c.p.¥. of 0, for values of s ranging from two up 9 ten. 
Taking the case s = 6 and following his method (1954, 1956) an approximation to the c.D.F. of the largest 
of six roots, useful for computing the upper percentage points, has been obtained in the form: 

T(2m + 2n+ 12) T(m+3) (n+ 3) 
40 (m+n + 4) 1'(2m +6) I'(2n+ 6) 
T(2m+ 2n+ 12) T (m+ 3) T(n+3) 
2(m+n+5)T(m+n+ 4) D(2m+ 5) T(2n+ 6) 
_T(2m+ 2n+ 10) (m+ 2) P(n + 3) [8(m+n+4+ 5) (m+ 2)+(n4+1)] 
2T(m+n-+5) T(2m+ 4) T(2n+4 6) 

T'(2m + 2n +10) P(m+4) P(n+3) 
2(m + 2) T'(m+n+ 5) D(2m + 3) T(2n+ 6) 
T(2m + 2n +8) T(m+ 4) T(n+3) 
~ 20 (m+n-+ 4) I'(2m + 3) I(2n + 6) 





Pr(#, <x) =1- 


m+5(] — g)n+l 





am+4(] — g)nt 





am+s(] ais a)nti 





m+2(] deat x)" 





emt] —x)"+1, (3) 


For the details on the derivation of (3) the reader is referred to Bantegui (1958). 


3. UPPER PERCENTAGE POINTS 


Pillai (1954, 1956, 1957) using his approximation formulae, gave the upper 5 and 1 % points for the 
largest root for s = 2 ands = 5. These values were given for m = 0(1)4 and n varying from 5 to 1000 and 
are given to three or four significant figures to ensure sufficient accuracy for interpolation. Similarly, 
Sen (1957) gave tables of the upper 5 and 1 % points for 3 roots and Ventura (1957) for 4 roots. Pillai 
has published all these four tables, for s = 2, 3, 4 and 5 (1957). 

Foster & Rees (1957) have tabulated the upper percentage points (80, 85, 90, 95 and 99) of the largest 
root for s = 2,m = —0-5,0(1)9 and m = 1(1)19(5)49, 59, 79. Foster (1957, 1958) has further extended 
these tables for values of s = 3 and 4. The arguments they have used for tabulation are v, = 2n+s+1and 
Ve = 2m+8+1. 

Bantegui (1958), also following the same approach as that of Pillai and using equation (3), obtained the 
percentage points for s = 6. These are presented in Tables 1 and 2. For computing the values of Pr (0, < 2), 
a trial value was extrapolated from Pillai’s tables (1957) of percentage points of the largest root for 
8 = 2, 3, 4nd 5 for each of the 5 x 16 = 80 combinations of m and n; the trial value and a few values 
around it were then examined and backward linear interpolation carried out using two values, one giving 
probability above and the other below the significance level. 


4. ERROR OF APPROXIMATION 


The error of approximation of the upper percentage points of the distribution is taken to be the difference 
between the approximate and exact probabilities. Pillai (1954), Sen (1957) and Ventura (1957) madesuch 
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Table 1. Upper 5% points of the largest root for s = 6 
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m 
n 
0 1 2 3 4 
5 0-8246 0-8499 0-8685 0-8830 0-8945 
10 6552 6917 7206 “7442 7639 
15 5371 *5758 *6077 6346 *6577 
20 4535 4912 5231 5505 5746 
25 3918 4276 4583 4852 5091 
30 0-3447 0-3782 0-4074 0-4332 0-4564 
40 2775 3069 +3329 3563 ‘3776 
60 1995 +2225 +2433 2624 *2801 
80 1556 1745 1916 +2075 +2224 
100 1275 1434 *1580 “1716 1843 
130 0-10036 0-11319 0-12504 0-13615 0-14666 
160 -08272 -09348 -10388 *11284 *12175 
200 06702 07586 08409 09186 09926 
300 *04545 -05156 05728 -06281 -06790 
500 02765 03143 03498 03835 04160 
1000 01397 01590 01772 01946 02113 
Table 2. Upper 1% points of the largest root for s = 6 
m 
n 
0 1 2 3 4 
5 0-8745 0-8929 0-9065 0-9169 0-9255 
10 *7173 7482 “1724 7922 8086 
15 -5986 6334 6619 6858 7063 
20 “5111 5462 *5757 -6010 6231 
25 -4450 -4790 -5081 5335 -5559 
30 0-3936 0-4261 0-4542 0-4789 0-5011 
40 3194 “3484 3739 3969 *4177 
60 *2315 +2548 *2757 2948 -3125 
80 1814 -2006 2181 +2342 +2493 
100 1491 1654 1803 1942 -2072 
130 0-11762 0-13091 0-14314 0-15457 0-16536 
160 09713 -10830 -11901 *12834 *13754 
200 -07880 -08803 -09659 -10466 -11232 
300 05355 05996 06594 -07160 07701 
500 03270 03661 04034 04388 04727 
01651 01855 02046 02229 02405 
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studies for s = 2, 3 and 4, respectively. A comparative study of the values of the error of approximation 
they have obtained indicates that; 

(1) There is greater agreement between the probabilities for the approximate and exact cases in the 
upper 1 % points than in the 5%. 

(2) The difference between the approximate and the exact probabilities in the upper 5 % points occur 
in the fifth decimal place, which on rounding gives a difference of orly one in the fourth decimal place. 

(3) Taking any value of the parameter m constant, the error of approximation increases slowly as the 
other parameter is increased; such increase occurs only in the sixth decimal place or at most is unity in 
the fifth decimal place when rounding. 

The error of approximation was similarly studied for s = 6. From Table 1, the percentage point for the 
parameter m = 0, n = 500 is 0-02765. At this percentage point, the numerical value of the approximate 
c.D.F. is 0-9500515, while the probability based on the exact formula is calculated to be 0-9500105. The 
error. of approximation is then equal to 0-0000410 which occurs in the fifth decimal place. This result is 
consistent with that for lower values of s. It can therefore be concluded that the approximation formula (3) 
is sufficiently accurate for the computation of the upper 5% or lower percentage points of the c.D.F. of the 
largest of six roots. 

It is to be noted that the error of approximation discussed above is not the same as the error in the 
percentage points. However, acomparison of the percentage points obtained, for instance, for s = 3 based 
on Pillai’s approximate formula (Pillai, 1957) with Foster’s table (1957) reveals that the approximation 
is sufficiently accurate to justify the retention of 4 and 5 decimal places for the 95 % level. In fact, the 
approximate formula is adequate even for percentage points slightly below the 95% level. Foster & Rees 
(1957) have also discussed this point for s = 2. Since the error of approximation obtained for s = 6 agrees 
with that computed for smaller values of s, the accuracy of the approximation for the present case is 
evident. 
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5. SUMMARY 


In this paper the cumulative distribution function of the largest of six roots of a matrix in multivariate 
analysis has been studied. An approximation for obtaining upper percentage points (5 % or less) to the 
c.p.F. of the largest of six roots has been obtained following Pillai’s method and numerical comparison 
was made of the probabilities obtained using the exact c.D.F. and the approximation to it. Since the 
comparison showed that the error of approximation was negligible, upper 5 and 1 % points were computed 
for small integral values of one parameter and values of a second parameter ranging up to 1000. 


The authors wish to thank the Statistical Center, University of the Philippines for the facilities 
extended them during the preparation of this study. 
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The rank analogue of product-moment partial correlation and regression, 
with application to manifold, ordered contingency tablest+ 


By ROBERT H. SOMERS 
Bureau of Applied Social Research, Columbia University 


Daniels (1944) has demonstrated that the ordinary product-moment correlation, Spearman’s rho, and 
Kendall’s tau, are all special cases of a generalized correlation coefficient. This paper will demonstrate 
that a generalized partial correlation coefficient can be defined, as a simple extension of Da:tieis’s theory. 
Kendall’s partial tau will be seen to be a special case of this product-moment type partial coefficient. 
Thus, it is neither coincidental, nor remarkable (Kendall, 1955; Moran, 1950), that Kendall's partial tau 
is the same function of total taus that the product-moment partial is of total r. While the partial coeffi- 
cient described here is of the first order, its form suggests a generalization to partial correlation of any 
order, which will be investigated at a later date. The theory will be seen to be immediately applicable to 
partial association in manifold, ordered, contingency tables, inasmuch as the partial tau here described 
is equally applicable to the case of ties among the rankings. As a further extension of product-moment 
theory to order statistics, the regression equations implied by Kendall’s 7, and 7, will be described and 
illustrated, and the possibility of partial regression indicated. 

No remarks are made here about sampling distributions. However, it is hoped that the generalized 
partial coefficient defined below will contribute to the difficult problem of the sample distribution of 
partial tau. 

Daniels’s generalized coefficient of correlation, 


_ Laas is 
J {Zaj, Xbj;} ‘ 








is constructed in the following manner (cf. also Kendall, 1955, Ch. 2). When considering the correlation 
over n objects between two variables, P and Q, the objects are first numbered in arbitrary order, and all 
n® permuted pairs of objects are formed. Each pair is assigned a certain score, a;;, for its value on variable 
P, and b;; for variable Q. The ordinary product moment r becomes a special case of when the assigned 
score, @;;, is the difference in variate values of the ith and jth objects. Spearman’s rho becomes a special 
case when the difference in ranking, rather than difference in variate value, is the score assigned to each 
pair. Finally, Kendall’s tau is a special case of I when each pair is assigned a score of {+ 1/— 1} for pairs 
in which the jth member of the pair ranks {higher/lower} than the ith member, and 0 when the ith 
object is paired with itself, or when the ith and jth objects have the same rank. 

This last case gives Kendall’s 7,. Since manifold, ordered, contingency tables may be considered 
rankings of objects with many ties, Kendall’s 7, is a useful coefficient of correlation for such data. 

For convenience, we shall change Daniels’s notation. We shall designate the scores as u; for variable 
P, v; for variable Q, and w; for variable R, fori = 1, 2,...,q, where g = n?. The manner of assigning scores 
is unchanged ; we shall simply let Daniels’ a,; become u,;_,),;, for example. Thus Daniels’s generalized 
coefficient becomes . 

U4 V; . 
Tpg = Judo} (for + = I,...<,@). 

In the following discussion we shall consider the u;, v; and w; scores as components of vectors in 
q-dimensional Euclidian space, always taken relative to a fixed, normal, orthogonal basis. Thus, if we 
have n objects ranked on variables P, Q and R, we shall use the symbols P, Q and R to represent vectors 
having q = n* components, 


P = (Uy, tgs 000yUq)> Q = (Vy, Va, --09Uq), R= (Wy, We, ..-, Wa) 


Further, as in ordinary vector analysis 


[P| = (ut +ud+...+u2), 


+ This article may be identified as Publication No. A—-252 of the Bureau of Applied Social Research, 
Columbia University. I am indebted to my colleague, Herbert Menzel, whose analytical problem led 
to, and whose ingenuity aided in, the pursuit of these results. The preparation of this paper was 
facilitated by funds obtained from the Bureau of Applied Social Research. 

16 Biom. 46 











242 


and we shall designate the unit vectors 
P pele: Q ‘lie R 
Pl’ * iq’ RI 


The scalar (‘inner’ or ‘dot’) product of two vectors is, as usual, the scalar 
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a= 


(P.Q) = uz vy t+ Ugvet... + Ugry: 


At this point we diverge from the usual vector notation. We need to employ the notion of vector (or 
‘outer’) product. But this is ordinarily defined only in three-dimensional space, and we operate in a space 
of far higher dimension. The generalization of the vector product to such a space ordinarily requires 
tensor notation (Kaplan, 1953, p. 161), but we shall avoid introducing new notation by defining 
a generalized vector product, which can be treated as a vector in a companion space, just as it is in 
3-space; 

(P x Q) = (uy, Vq— Ug, Uy Vg — Ug}, «++ Ug_1 Ug — UgUg-1)> 


i.e. a vector whose components are determinants of the 2 x 2 matrices of the form 


aN , allz <j, lexicographic ordering. 
d grap & 








% 


This vector therefore has 4q(q¢— 1) components, and is the vector perpendicular to the plane defined by 
the vectors P and Q. (Note that (P x Q) = —(Q~x P).) 
Having established these definitions, we see immediately that 


Tpg = (%.%,), Tpr=(,.%3) and Tgp = (&_.as). 


(4 X Hg) .(&% X Hs) 
| (ty X Og)| | (oy x &s)| 





We shall show that Tor.p = (1) 


is precisely the partial tau defined by Kendall as a phi coefficient} of a certain fourfold table (Kendall, 
1955, p. 118), when the vectors a; consist of scores appropriate to tau. With the appropriate scoring, this 
apparently becomes either a partial Spearman’s rho, or the product-moment partial r. 

From the analogous theory in 3-dimensional vector space, this form suggests that the partial can be 
treated as the cosine of the angle between the perpendiculars to the planes defined by the vectors a, a, 
and a, a. Geometrically, this is seen to be equivalent to the representation of the ordinary product 
moment partial coefficient (cf. Kendall, 1948, p. 372) as the cosine of a different, but equal, angle—the 
angle between the two planes. In the ordinary representation of orthogonal projections on a subspace of 
one less dimension, the partial would be expressed as (cf. Birkhoff & MacLane (1949), p. 187) 


[0 — (1. Og) % 1]. [os — (&%.%3) &] 
|g — (Oty. Obg) Oty| |g — (Hyg) | : 





ToR.P = 


which is equivalent to the above form. However, the former has obvious advantages of representation, 
and immediately suggests the generalization to a partial of any order, since the vector product can be 
generalized to any number of vectors. 

In order to show that (1) is the partial tau defined by Kendall, it is only necessary to observe that 


(Gy X Oy). (Hy X Wg) = (H%,.0y) (Hy.%y) — (OL .%y) (%y.y). 


This is a well-known identity in 3-space, and will be demonstrated in the general case below. If this is 
true, then, since the a, are unit vectors, («,.a,) = 1. Moreover, (@).a3) = Tgp, (&-%) = Tpg and 
(@.%3) = Tpr. Thus the numerator is, as it should be, 7gg—TpeTpr- In the denominator, we have 


| (ey X Oq)| = a/[(ay x Og). (ry X Og)] = y/[ (1-1) (eq. Oey) — (Oy. hg) (%y.Xg)] = (1-7 9); 


and similarly for |(«, x )|. We have thus reduced the vector definition to Kendall’s partial tau. 
Furthermore, the form of the partial immediately suggests the partial regression coefficients and partial 
covariance. It might be noted that the partial variance (|«, x ,|)* is the determinant |, A;|, where A, 
is the 2 x q matrix with rows a, and a. 


ad — be 


V{(a +b) (a+) (b+d)(c+d)} 
lation of a fourfold table. 


+ The phi coefficient, 





, it should be noted, is the product-moment corre- 
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We shall show that this equivalence between partial 7 as the cosine of the angle between vectors, and 
partial 7 as defined by Kendall, holds by enumerating the vector product. We have: 


ay = (uy, Ug, eos Ug)» 
Xe ~~ (v4, Os eees 0%) 
Qs = (Wi, Wy, ...,W)> 
ie. unit vectors, where, for example, uj = u,/|P|. Kendall’s partial 7 is 


P i” Xv}, w;, — Luj vj; Luu; 
ORF Vill — (Sujoz)*1 1 — (Saji)? }} 





We will show that the numerator of this coefficient is equivalent to (a, x @,).(%, x &3). Since we used the 
same expansion rule for vector products in establishing the denominator, this will suffice for establishing 
the equivalence. 
By definition (and omitting primes on uj, vj and w), 
(Oy X Oy). (Oy X Og) = (Uy Vg— Uy Vy) (Uy We — Ug Wy) +... + (Uy Vg — Ug) (Uy Wy — UgWy) 
+ (Ug¥g — Ug Vg) (Ug Ws — Ug Wy) +... + (Ug_1 Vg— Ugg) (Ug_y Wg — Ug Wq_s)- 
This can be broken up into some positive terms with ujv,;w;, and some negative terms of the form 
U,U;(V;wW;+v;W;), the former for 7 + j, the latter for i <7. These two groups of terms are reduced as 
follows : 
Lujvjw; = Yui dvwjw,;—LUulojw, (¢+7, all i,j =1,...,9) 
a j 


DY uU,(v,w; +0;w;) = HY ui Dd uj(v,w; + vj, w,) — 2ujv,w,) (all i,7). 
i<j i j 
But, since these are unit vectors, Du? = 1. Thus 
(Oy X Hy). (% X Hg) = Dv,w,—F[Luj,u,(vjw;+vj;w,)] (all ¢,7), 


and we merely need to show that the negative term is Lu,;v,;Lu,;w;. Since the matrix of terms 
U,U,(V;w; +; w,) is Symmetric 


Du, u,(v,w;+v,;w,)] = Y uzu,(vj;w;+v;w,) + Dujv,w; (all i,j) 
i<j 


» U,DUu,(v;w;)+ x Lu,(v;w,) + Dujo,w, = Lu,v, Duwi, 
< i< 


and the equivalence is established. 

A numerical example of the partial 7 computed by means of the vector formulae will serve for illustra- 
tion. For simplicity we shall avoid the redundancy involved in 7 when computed from Daniels’s 
generalized coefficient. As Kendall (1955, p. 20) notes, the Daniels’s scoring rules give a numerator and 
denominator of 7 twice the size of those given by the usual computing methods. Similarly, Daniels’s 
notation increases the size of the vectors we have to consider, by adding redundant information. Since 
these vectors are large in any case, we have computed by means of reduced vectors, those consisting only 
of terms a,; such that 7 <j. 

Using the example of Kendall (1955, p. 117), and denoting the reduced vectors by the superscript,* we 
see that P, Q and R each have 15 components; the scores assigned to the 15 pairs as shown at the bottom 
of p.117. Obviously |P*| = |Q*| = |R*| = ./15, and the a, are unit vectors constructed in the usual 
fashion. Then (a, x @)*, (a x &3)* and (a, x &)* are vectors with $m(m-— 1), or 105, components, where 
m = 4n(n—1), n being the number of objects ranked. Each component is a score assigned to each 
distinguishable pair of pairs, the score being +2/m or 0. In the tied case there will also be scores of 

+1/m. In this example, we find 


176 
152” 
216 
152’ 


|(oy x ay)*| = ./{15-*[4(25 + 19)]} = / 


|(ce, x otg)*| = Y{15-*[4(35 +19)]} = J 


4(6-15) 


and &. *. *= 9 
as (% X &%y)*. (&% x Og) 15? 
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. sha: — 36 
giving TQR.P = J{(216) (176)} ~ 
in agreement with Kendall. 

For those who work with manifold, ordered, contingency tables, it should be emphasized that these 
vector operations hold equally well for 7,. Thus, when there are tied ranks 
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— 0-185, 


is also the product-moment analogue of a partial correlation for contingency tables.t 

As illustration of the meaning of Kendall’s tau, it may be useful to consider the regression equations 
2%) 
|Q| |R| 
the variance of scores on Q may be defined as |Q|*. Thus, regression coefficients may be defined in the 
same way as in product-moment theory. In the case of total regression, for variables P and Q with no ties 


implied by the product-moment analogy. From our definition of Ter = (%,.a3) = , it is clear that 








_ 9 _(P-Q)_ (P.Q) 
A, =h,= |Q\? _— |P|? ’ 
since |P| = |Q| = n(n—1), where we have ranked n objects (without ties). The same example given by 


Kendall may be used to illustrate these coefficients. Here we have six objects ranked without ties, on 
variables P and Q. There are thus 36 possible pairs (considering all permutations) and six of them will be 
assigned a score of 0 on both variables, since they are of the form a;;. According to the scoring described 
above, and following Daniels, these pairs give the following scatterplot. 


Q Q! B 


+ +14 + 





+ 7; + 


‘oy @ 


Fig. 1. Scatter diagram of pairs of observations implied by Kendall’s 7,. 





(The circled figures are the number of permuted pairs given the indicated P and Q scores.) 


2. .o _ is 
Pr = Pa= a1) = 30" 


P = 7 = 0, so the regression equations are as shown, 
P=0-47Q and Q=0-47P, 
Tpg = V(f,f2) = 7/15, in agreement with Kendall. 





In the case of tied rankings, say a contingency table as shown in Table 1 (from Lipset e¢ al. (1951), 
p. 347) the scatterplot of pairs would be that given in Fig. 2. 


+ Such a partial coefficient for the tied case was used in an illustrative example, without justification, 
in a recent text; Sidney Siegel, Nonparametric Statistics for the Behavioral Scientist, p. 227. New 
York, 1956. 
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Table 1 
| Level of knowledge 
| 
| 
Low Medium High Totals 
Voting in accordance with Yes 46 55 39 140 
predisposition No 9 35 38 82 
Totals 55 90 77 222 























Since this is equivalent to ranking 222 objects, with many ties, there will be 49,284 permuted pairs 
entering into the scatterplot, in the following manner, where Q represents knowledge and R, vote. 


R 
Gan } 


+ 17 x 





2010 
p07 
an , 0 +1 Ss 








Fig. 2. Scatter diagram of pairs of observations implied by Kendall’s 7,. 


(Again, the circled numbers are the number of permuted pairs at the given points.) 





3237 3237 
F th tterplot, = —— = 0-201, = ——— = 0-282 
alae alia a A. = Tert6 Ps = T1480 
Again the means are 0, and the regression equations become, 
Q=0-201R, R= 0-282Q. 
The value of ,/(f; 82) waa 0-238. This, as we would expect, is exactly the value of 7; 
= = 0- . 1s, 9 
1a) ~ \{(16115) (11480)} P y ' 


for the contingency table given above. It will be noted that only in the case of ties among the rankings is 
it possible for the regression coefficients to be unequal. This is obvious from the redundancies in the 
seatterplot. It will be noticed that the first row of the scatterplot (Fig. 2) is the reverse of the last, and 
similarly for the columns. Again, this redundancy enters in because of the rule used in assigning scores; 
Oy = — Ay. 

Further work is in progress on the order statistics analogues of product-moment statistics. On the basis 
of Daniels’s initial conceptualization, it seems clear that a general partial and multiple correlation and 
regression theory for order statistics can be generated. Similarly, the correlation ratios, for the case of tied 
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ranks, seem to be equivalent to assymetric coefficients of association for a contingency table that does not 
have ordered variables, i.e. attaining their maxima when the observations in any row or column fall 
entirely within one cell. 

Finally, we may suggest an alternative point of view to those who reject such product moment 
derivatives as phi on the grounds that they have no ‘operational meaning’ (Goodman & Kruskal, 1954), 
While such meaning for a coefficient is often desirable, there are other times when theoretical power 
assumes greater importance. Often both theoretical power and operational meaning cannot be attained. 
The present investigations have resulted from a need for a coefficient of association in manifold, ordered, 
contingency tables which would permit logical inferences to be made about operationally undefined 
intervening variables. Thus a coefficient was needed which would give information about a partial 
coefficient when only the total coefficients were known. Obviously, if a choice had to be made in this case, 
theoretical power could not be sacrificed for the sake of operational meaningfulness. 
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The busy period in relation to the queueing process GI/M/1 
By B. W. CONOLLY 


ABSTRACT. A treatment by difference equations is given of the probability distributions 
associated with length of the Busy Period in connexion with the simple queueing process with 
general input and random service. A numerical comparison is made in a few typical cases between 
the processes M/M/1 and D/M/1, the latter being of interest in connexion with appointment systems. 


1. INTRODUCTION 


Kendall (1953) suggested the notation GI/G/N as a compact description of an N-server queueing process 
in which the inter-arrival intervals are independently and arbitrarily distributed, and the service 
intervals are also arbitrarily distributed. ‘GJ’ refers to input, and ‘G’ to service. 

The process which will be considered here has the general independent input, while the service has 
probability density function (P.D.F.) of the negative exponential, or ‘Markovian’, type, viz. 


e-tib/b, (1-1) 


Service is supplied by one server, and the queue is dealt with in order of arrival. Inter-arrival intervals 
and service intervals are statistically independent. 

A consequence of the negative exponential assumption for service is that the probability b,(t) of the 
completion of n consecutive service periods in an interval (0,¢), the (n+ 1)th being in progress at the 


instant ¢, is given by ba(t) = e-*(t/b)™/nt. (1-2) 
Denoting the P.p.F¥. of inter-arrival intervals by 
a(t) (0<t<o) (1:3) 


with mean a, we shall indicate by c,(¢) the P.p.F. associated with an inter-arrival interval of length ¢ 
during which time n consecutive service periods are completed, the (n + 1)th being in progress at the end 
of the interval. Thus, 

c,(t) = a(t) b,(t). (1-4) 
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not Most of the following investigation will involve Laplace transforms. In general, we shall use the corre- : 





fall sponding Greek letter for the transform of a function denoted by a Roman letter. 

i 2. THE BUSY PERIOD 

54), 

ower From the server’s viewpoint the progress of a queueing system of the type considered here is a succession 
ned. | of alternating periods of idleness and full occupation. It is the latter which are called Busy Periods (often 
red, abbreviated to B.P’s.), and the object of the investigation is to make probability statements about the 
ined lengths of B.P’s. 

rtial The length in time can conveniently be treated in the manner of Bailey (1954). Essentially this con- 
ase, sists in a study of the special process the starting point of which is the arrival and immediate reception of 


service of a customer, and which terminates when the server becomes idle once more. The crux of the 
present treatment is the simultaneous investigation of length, measured in time and number served, by 
an integro-difference equation technique of the type used in Conolly (1958). This is a versatile method, 
and the author has in essence used it also to study the B.P. in connexion with the system GI/H,/1 (an 
illan extension of the present work), and with #,/G/1. Earlier work by other writers is mentioned in Kendall 
(1951), and, more recently, there is a comprehensive study in connexion with the processes M/G/1 and 
mple D/G@/1 by Takaes (1955). 
To be specific, in this paper we shall investigate the probability density functions p,,(t) associated with 


atist. the termination of a B.P. in the small time interval (¢, t+ dt) after it began, a total of m customers having 
received service. Then « 
= t) dt 2-1 
Ltd. Pm i) . Pmt) (2*1) 
itd. 


is the probability that a total of m customers receive service during a B.P., whatever its length in time, and 


dias pit) = DS pul?) (22) 
m>1 


is the P.D.F. associated with termination of the B.P. in (t,¢+dt), however many customers are served. In ¢ 
conditions favouring a steady state we shall expect to find that 


[ipa = 1. (23) 


Otherwise the integral will be less than unity and a definite probability will exist of B.P’s. of infinite 
duration. 


3. BAsIc THEORY 


cc re YF & 


We introduce a P.D.F. fmn(t) associated with the following composite event: 


(i) a customer arrives at ¢ = 0 and immediately begins to receive service; 
Ocess (ii) a further arrival takes place in the subsequent small interval (¢,¢+ dt) ; 
rvice (iii) as a result of this arrival the total number waiting in the queue is n(n > 1); 

(iv) at the time ¢ of this arrival the mth customer to be served in succession is at the counter (m> 1). 
e has Then, for n = 1, we have 


tm—-1 
ft) = [ "3 fare ot—8) ds, (3:1) 
(1-1) KY 
pen for m > 2, together with Silt) = colt). (3-2) 
The explanation of (3-1) is that at the time of the previous arrival, in (s,.s +ds), say, any customer from 
of the the first up to the (m—1)th could have been at the counter. If it was the (m—r)th the previous arrival 
at the must have created a queue of 7, of which the last member must be at the counter at ¢. The arrival at ¢ 
(1-2) is then the only one waiting. 
Jumping directly to Laplace transforms we obtain 
z) = Yo(2), (3°3) 
(1-3) Parl Yo 
m—1 
ngth ¢ and $mi(2) = = bm-rr(2) Yr(2), (3-4) 
he end oak 


, where y,(z) is the Laplace transform of c,(t). 
(1-4) 
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Generalizing (3-4) for n > 2, and omitting arguments, we obtain, 


m—1 
Pmn = »y ee, (3-5) 
r=0 
Writing ®,(y,z) = »» Y drn(2) 
rT) 


for the generating function of the Laplace transforms ¢,,,, we obtain by addition of (3-3) and (3-4) 
multiplied by appropriate powers of y the infinite difference equation 


(yz) = yYol2) + a Y"Yr(z) Oy, 2) 5 (36) 
rT) 
and for n > 2, ®,(y,2) = x I YZ) DnrsrlYs 2). (3-7) 
r>% 


Following the usual method for the solution of this type of difference equation we substitute, in 
(3-7), x" for ®,. The equation thus becomes 


x = I(ay,z), (3-8) 
where Ty,z) = Dy’ v-(2) 
20 
co 
=| a(t) exp[—t(z+(1—y)/b)] dt 
0 
= a(z+(1—y)/b). (3-9) 
If ,(y, z) are the roots in a of (3-8) (r > 1), 
®,(y,2) = Y K,(y, 2) Er (ys2)s (3-10) 
rT 
the numbers K being independent of n. 
Now it is obvious that for |y| < 1 
|®,(y,2z)| < |®,(1,2)|. (3-11) 


Also >) ®,(1, z) is the Laplace transform of the probability of an arrival while the B.P. is in progress and is 


n 
certainly finite while R(z) > 0. Hence for R(z) > 0 and |y| < 1 the summation in (3-10) can only include, 
with modulus less than unity. By applying Rouché’s theorem for R(z) > 0 we find that (3-8) has only one 
root £ that fits this description, and substituting ®, = K&" for n > 1 into (3-6) we obtain K = y. Thus, 
forn > 1, < land R(z) > 0, : 
ly! ' ®,(y,2) = yS"(y,2). (3-12) 


4. THE LENGTH OF A BUSY PERIOD 


Our final objective is to obtain formulae connected with the P.D.F.’s, p,,(t) (ef. § 2). We shall denote by 
7,,(z) the Laplace transforms of these functions, and our objective will be realized by a formula for the 
generating function II(y,z) of the 7,,,(z), i.e. for 


II(y,z) = 2 y™ Mm(2)» (4:1) 
m1 
Then II(y, 0) is the generating function of the probabilities p,,(2-1) that a B.P. concludes after the service 


of the mth customer, while II(1,z) is the L.t. of the P.D.F. p(t) (2-2) associated with the termination of 
a@ B.P. in (t,¢+dt). 


7 co 
baclaa A(s) = ) a(t) dt, (4-2) 
8 
and d,(t) = A(t) b,(t). (4:3) 
6,,(z) will denote the L.1. of the d,, and its generating function 
A(y,z) = & y"6n(2) (4-4) 
n>1 


can readily be seen to be given by 


CO 
A(y, z) =| e—@+—w/b)s_4 (8) ds 
0 


= b((1—T(y,z))/(z+1—y)], (4-5) 











3-5) 


3-4) 
3°6) 
3°7) 
, in 


3-8) 


3-9) 


(4-5) 
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since in e—*§ A(s)ds = (1—a(z))/z. 


Now pr(t) = A(t) e-**/b, (4-6) 


since the probability that the B.P. terminates in (¢,t+ dt) after the completion of service of the first cus- 
tomer is simply the joint probability that no one arrives in (0, ¢) and that the service of the first customer 
is completed in (¢,¢+dt). For m > 2 we have 
1 fim-1 
Pnit) = b >> Sm-—rr(8) d,(t— 8) ds, (4-7) 
0 r=1 
since, if, at the arrival before ¢, the (m—r)th customer was at the counter, this same arrival must have 
created a queue of r(1 < r < m—1), and the whole of this queue plus the customer at the counter must be 
disposed of in the remaining time interval, the last in (¢, + dt), during which time no further arrivals can 
take place. The associated L.T.’s are 
77,(z) = 6,(z)/, (4:8) 


jm-1 
and, for m > 2, Ny(2) = , x $m-—rr(Z) 6,(2). (4-9) 
r= 


By comparing coefficients of powers of y it will be seen that 
II(y, z) = [ydo(z) + Ly (2) D,(y, z)]/b 
r> 


= yA(Ey, z)/b 
= y(1—§)/(bz + 1—£y). (4:10) 


5. LimrriIne BEHAVIOUR OF II (y, z) 


Although (4:10) has only been proved under the conditions |y| < 1 and Rlz > 0, its validity can be 
extended to include z = 0 if |y| < 1, and, in circumstances to be investigated, if y = 1. In point of fact 
II(y, 0) and IT(1, 0) are of direct practical importance; the former since it is the generating function of the 
probabilities ,, relating to the length of a B.P. in terms of customers served; the latter, since it is the 
probability of termination in finite time. Moreover, the value N of 


ee “| 
dy _ 


is the average number of customers served during a B.P. 
The limiting behaviour of II(y, z) is required essentially for all values of the congestion index p = b/a. 
We commence with the study of II(1,z). By (4-10) this is 


TK(1,z) = (1—§)/(bz+1—§), (5-1) 
where £ is the smallest root of a =T\(a,z) = a(z+(1—2)/b). (5-2) 
If we can expand ¢ into a Taylor series in z we obtain 
E(z) = x k,2", (5-3) 
n>0 
ad” 
where b= [=| |. (5-4) 
a ti. 


1—k)—k,2—0(z) 


Th " 
a wena 5 Se ee 





(5-5) 


By the theory of Branching Processes it is known that: 

(i) When p < 1, ky < 1. It is evident that as z > 0, II(1,z) > 1, exactly as would be expected in 
steady state conditions. 

(ii) When p > 1, ky = 1, and as z > 0, II(1,z) > k,/(k, —b) = p-}. It follows that a non-zero proba- 
bility exists of infinitely long B.P’s. 

(iii) When p = 1, £ = 1 is a double root of (5-2) with z = 0. The expansion of &(z) proceeds in non- 
integral powers, but its leading term is unity and again I(1,z) > 1 asz > 0. 
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Formulae for N can be obtained from 
II(y, 0) = (1—§) y/(1—£y), (56) 
where & is the smallest root in x of x = a[(1—-ay)/b]. 


Assuming it to be legitimate, we expand ¢ into a series of ascending powers of (1 —y), viz. 


4 = x h,(1—y)", 
n>0 


where a. = = EF: 


nm! Ldy" jy 





Differentiating (5-6) and letting y > 1 we obtain for p < 1 
N =(1-A,)-. (5:7) 


The limiting process is a little more complicated when p > 1. On the understanding that we refer only 
to B.P’s. of finite duration we obtain oa 
N = (hg—h,) p/hi- (5:8) 


6. THE system D/M/1 


It is well known that regularizing the input (which is the significance of D) has the effect of reducing 
customers’ average waiting time as compared with a random input, and any appointment system is 
a recognition of the fact. We can now study its effect on a B.P. If a is the interval between successive 
arrivals, we have . 

a(z) = e-*; (6-1) 
then in connexion with numbers of customers served our interest centres on the smallest root & of 


& = e“1-Enlp, (6-2) 
This can be expanded into the series 
_ P x (ny/perr)” 


yn n(n!) ’ at 


for instance, by assuming a Taylor expansion and calculating the coefficients by direct differentiation of 
(6-2). The result is quoted in Tak&cs (1955). ; 

If (6-3) be substituted into (5-6), then a little rearrangement enables the probabilities p,, concerning 
the termination of a B.F. after m customers have been served to be picked out as the coefficients of the 
powers of y. For instance, 


ae (6-4) 
Po = e~P —e-*/0(1 + 1/p), (6-5) 
Ps = €~*(1 + 1/p) —e-#0(1 + 2/p + 3/2), (66) 
Py = e-/0(1 + 2/p + 3/2p*) — e-#0(1 + 3/p + 4/p* + 8/3p%), (67) 
ps = e-*P(1 + 3/p + 4/p? + 8/3p*) — e-5/0(1 + 4/p + 15/2p? + 25/33 + 125/24p4). (68) 


These formulae can be used for all values of p. 

For the evaluation of (5-8) we have 
h, = —(p-1)7, (6-9) 
and hy = (3p — 2)/2(p— 1). (6-10) 


In the following Table 1 we give values of the first five p,, for a selection of values of p in the two cases 
M/M/1 and D/M/1, together with 


5 co 
Pm D“Pm and N. 
1 1 
It will be noticed that regularizing arrivals has the effect of increasing the probabilities of shorter B.P.’s. 


However, in the single instance considered with p > 1, the average number served during a finite B.P. is 
greater for the regular than for the random input. 














(5-6) 


(5°7) 
only 
(5-8) 


cing 
m is 
sive 


(6-1) 


(6-2) 


(6-3) 


m of 
ning 
’ the 
(6-4) 
6-5) 
6-6) 
6-7) 
(6-8) 


6-9) 
10) 


P. is 
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Table 1. Numerical quantities associated with the busy period for M/M/1 and D/M/1. 















































7 - - 
p Pi Ps Ps Ps Ps =Pm =Pm N 
M/M/1 
0-25 0-8000 0-1280 0-0410 | 0-0164 0-0073 | 0-9927 1-0000 1-3333 
0-50 -6667 -1482 -0658 | -0366 0228 | -9401 1-0000 2-0000 
1-00 -5000 +1250 0625 | -0391 | 0273 -7539 1-0000 oo 
1:50 | -4000 -0960 -0461 | -0276 | -0186 | 5883 -6667 3-000 
| | 
D/|M/\ 

0-25 | 09817 | 0-0166 | 0-0015 0-0002 0-0000 1-0000 10000 | 1-0174 
0-50 +8647 -0803 -0277 -0124 -0063 -9914 1-0000 1-2550 
1-00 -6321 0973 | -0465 -0287 -0199 +8245 1-0000 0 
1-50 | -4866 -0741 | -0334 -0190 -0124 +6255 0-6667 4-000 

| 
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The design of factorial experiments: a survey of some schemes requiring 
not more than 256 treatment combinations 


By R. G. MITTON anv F. R. MORGAN 
British Leather Manufacturers’ Research Association, Milton Park, Egham, Surrey, England 


INTRODUCTION 


Factorial experiments involving factors at two levels only are particularly simple to design and analyse 
and are widely used in consequence. Because 4- or 8-level factors can be regarded as formally equivalent 
to two or three factors at two levels, these can be incorporated also without trouble. The method for 
preparing designs for such experiments is straightforward (Fisher, 1926, 1935; Yates, 1937), but if they 
involve many factors the search for suitable designs may require some time. A number of designs for 
factorials with factors at 2, 4, and 8 levels are given in this paper in Tables 1-10. The schemes tabulated 
require up to 256 treatment combinations, and use is made of fractional replication (Finney, 1945), but 
not partial confounding. It is assumed that second and higher-order interactions can be used for the 
estimate of error, and for confounding (Fisher, 1935; Finney, 1947), but main effects are unconfounded 
and, where possible, first-order interactions also. In the schemes with fractional replication, no main 
effect or first-order interaction has as alias an interaction of lower order than the second. 

The tables have been made as complete as possible (subject to the restrictions stated), but it may well 
be that some of the designs can be improved by modifications which have not been found during our 
search. A few of the schemes are essentially similar to those given by other workers; e.g. Yates, 1937; 
Brownlee, Kelley & Loraine, 1948; Cochran & Cox, 1950; and U.S. Department of Commerce, 1957. 
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EXPLANATION OF THE TABLES 


The standard notation developed by Fisher (1935) is used, capital letters denoting the main effects and 
interactions, and small letters the treatment leveis. Where a scheme involves 8-level factors these are 
written first and allocated the first letters of the alphabet (ABC for the first 8-level factor, DEF for the 
second). Four-level factors are written next, and each is allocated two of the first available letters; the 
remaining letters (with J and O omitted) represent 2-level factors. 

Each scheme is given a reference number consisting of five digits. The first three of these give the 
number of 8-level, 4-level and 2-level factors, respectively. Fractions of a replicate are indicated by the 
fourth digit m, and the number of blocks by the fifth digit n; the scheme is a (4)™ replicate in 2” blocks. 
Where necessary, brackets are used in the scheme number; e.g. 10(11)63 indicates a scheme for one 8-level 
factor and eleven 2-level factors, and is a #; replicate in 8 blocks. 

All the schemes in any one table have the same number of (equivalent) 2-level factors, aad the table 
gives the scheme number, the generators of the defining contrasts and of the interactions confounded, the 
generators of the principal block, the generators of the multipliers which operate on the members of the 
principal block to give the remaining blocks, and the degrees of freedom available for estimating error. In 
several of the schemes one or more first-order interactions are confounded with blocks; these are tabulated. 

The statistical analysis of the data from an experiment with fractional replication is carried out by first 
neglecting certain of the factors so that a complete replicate of those remaining is obtained. The contrasts 
are then obtained for this remainder in the usual way (Finney, 1946; Yates, 1937). All the schemes given 
are such that the last letters can be omitted for this purpose; thus, scheme 10(11)63 has 14 letters of 
which 6 are to be omitted, leaving ABCDEFGH. 


We wish to thank the Director and Council of the British Leather Manufacturers’ Research Association 
for permission to publish this paper. 


REFERENCES 


Brown EE, K. A., Ketty, B. K. & Loratng, P. K. (1948). Fractional replication arrangements for 
factorial experiments. Biometrika, 35, 268. 

Cocuran, W. G. & Cox, G. M. (1950). Haperimental Designs. New York: Wiley and Sons. 

Finney, D. J. (1945). Fractional replication of factorial experiments. Ann. Eugen., Lond., 12, 291. 

Finney, D. J. (1946). Recent developments in the design of field experiments. III. Fractional 
replication. J. Agric. Sci. 36, 184. 

Fryney, D. J. (1947). Construction of confounding arrangements. Emp. J. Exp. Agric. 15, 107. 

FisHer, R. A. (1926). The arrangement of field experiments. J. Minist. Agric. 33, 503. 

FisHer, R. A. (1935). The Design of Experiments. Edinburgh: Oliver and Boyd. 

Yates, F. (1937). The design and analysis of factorial experiments. Tech. Commun. Bur. Soil Sci., 
Harpenden, no. 35. 

U.S. DEPARTMENT OF COMMERCE (1957). Fractional factorial experiment designs for factors at two 

levels. Nat. Bur. Standards Appl. Math. Series, no. 48. 


























ible | | 


4 











Miscellanea 


Tables 1-10 





Table 1. Designs of type 2° 








| | 
| | Generators of 


Multipliers 


D.F. 


lst-order 





























Scheme Generators of interactions | Generators for | | : ; 
; Hae for other for interactions 
number |definingcontrasts; confounded | principal block | 
| | : blocks error | confounded 
with blocks | 
| | 
Full-replicate designs: 32 treatment combinations | 
00502 | | | | 13 bs 
a i. | ACE, BDE abe, ac, bd a,b { | 20 | = 
| 
02101 : (| 8 _ 
mit — | ABCDE ab, ac,ad,ae | a fis + 
| | | | 
Table 2. Designs of type 2° 
| 
Full-replicate designs: 64 treatment combinations | 
00603 | | | | 35 | _— 
01403 | +t. | ABCD, ABEF, | acf, ade, | py 31 — 
02203. | ACE | bee Bais | 27 | ABCD 
03003 | | | 23 | ABCD, ABEF, 
| | | | | CDEF 
02202 | | | | | | 30 — 
03002 | Beis | ad, bf, ce, | | 24 | — 
10302 ty imi aa +. +e | 26 | _ 
11102 | | | | 19 | ACDE 
| | | | 
|  Half-replicate designs: 32 treatment combinations | | 
00613 ABCDEF ACE, BDE, BCF\ abcd, abef | ab,ac,ae | 6 AB, CD, EF 
00612 ‘ | 8 CE 
aa | ABCDEF ACD, BCF ad, bf, abce ab, ac { S hae 
00611 ad, ae, be, 9 — 
oui. | }4BODEF ADE ¥ ae | 5 . 
| | 
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Table 3. Designs of type 2? 





Generators of 

















Sita 











defg 


Scheme Generators of interactions Generators for on | Be. : aob-cuer 
: Lge for other for interactions 
number | defining contrasts confounded principal block 
; | blocks error confounded 
with blocks 
| 
Full-replicate designs: 128 treatment combinations 
— ABCD, ABEF abcd, abef, a, b, ar a 
01504 os ACEG, ABG “3 80 ABG 
02304 ; — e 76 | ABG, CDG, 
ABCD 
= ADEF, BODE, | abd, ace, a, b, ° es 
02303 -- BDFG b * 81 — 
03103 afg, beg 74 ki 
— ADE, BDF, ae, bf, cg, a, ¢, = vis 
11203 — CDG ee d 67 | ADE 
12003 fo 58 | ADE, BCFG 
11202 | it 70 — 
12002 — ACDF, BEFG pgs _— a, b 60 — 
20102 | | 9 39 47 | ACDF 
20101 id ABCDEFG ab, ac, a | 48 Jes 
ad, ae 
af, ag 
Half-replicate designs: 64 treatment combinations 

pln ABCD, ABEF, | abcd, abef an 11% ad 
01513 ABCDEFG ACEQ a r J nad 24 | ABG 
02313 | || 20 | ABG, CDG, 

| ABCD 

} 
01512 | ae, bf, dg, 27 jut 
omae | ABODEFG | ACE, ABOF pts ab, ad { 4 fe 
10412 ABCDEFG ADE, BEF | ad, bf, cg, ab, ac 15 — 

| 
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Table 4. Designs of type 2° 





























Coe Multipliers | p.F Ist-ord 
Scheme | Generators of interactions Generators for inka ‘ie Revit xd 
ber | defining contrasts confounded rincipal block for other oy ene 

emeesadll haus — with te inn yieto re blocks error confounded 

|  Full-replicate designs: 256 treatinent combinations 

00804 Ss ABCD, ABEF, abcd, abef, a, b, 204 — 
01604 ABGH, ACFH abgh, acfh C,e 198 — 
02404 ACH, AEG, 191 — 
03204 _ BFH, ea . se de ti 
04004 DFG —_ ' || 174 _ 
10504 183 — 
11304 BEH, BFG, ad, beg, cf a 174 |ABDE 
12104 _— ABDE, are ar 164 |BFG, ABDE 
20204 ACDF 5 149 |ABDE, ACDF, BCEF 
21004 137 | ABDE, ACDF, BCEF, 

EFGH,BCGH 

11303 se BFH, BCDF, ae, ag, bf, cd, a, b, 181 — 
12103 ABEFG abch c 170 — 

| 20202 | \ _ ABDEG, ad, bg, cf, eg, me { 158 — 
21002 | f ACDFH fh, def . 144 — 

Half-replicate designs: 128 treatment combinations 

00813. | 84 at 

| 01613 78 — 
02413 ABCF, ABDG, abcf, abdg, ab, ac, 71 — 
q3213 | [ABCDEFGH | Aner abeh, afgh ae ~=s«) |: 68 + 
10513 64 |ABCF 
11313 | 55 |ABCF,BCDE 
10512 | af, bg, ed, 67 —~ 
aa | | ABCDEFGH ABFG, ACDF Aye ab, ac { po ~ 

Quarter-replicate designs: 64 treatment combinations 

00822 | \ ACDEG, ach, bdg, 24 _ 
01622 } BCDFH —_ deh, abef seated { 18 a 
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} 
Table 5. Designs of type 2° 
| abbot | | ' 
enerators 0 cates 
Scheme Generators of | interactions Generators for eee | Be: | , into — 
3 apie | for other for interactions 
number |definingcontrasts; confounded principal block | 
s | blocks error | confounded 
| with blocks <a 
| 
Scheme 
Half-replicate designs: 256 treatment combinations | | f number 
00914 | | 195 | — 
01714 | : | 188 | — 
02514 | }ABCDEFGHJ -_ po | “aa . od << 180 — 
03314 , | JJ, Veg | , 171 in Quar 
04114 | | 162 | CGH | oo(10)24 
| 01824 
04113 ABCDEFGHJ | ADH, AEJ, | abde, achj, adfj, | ab, ac, 169 | — 02624 
sits BEG | aegh, cf | ad - 03424 
i: 04224 
nate | lapoperens ge gh | = adfh, | abae, |) 1¢9 | acpe 
12214 | | ' oe J | 7% || 150 | ACDE, ACFG, Hf yo93 
| | | DEFG 05023 
| 
11413 AEFG,CDEF, | abef,abde,abgh,| ab, ac, 167 | — 10723 
12213 }ABcDEF GHJ |" ABDEJ | acdg, bj | ad 155 | “a na 
| | | | 12393 
20312 ABCDEFGHJ | ACDG, BCEH ad,ag,be,bh, | ab, ac 141 | — 
| | fin abof | 
| 
es | | | ; | Eigh 
Quarter-replicate designs: 128 treatment combinations | peony 
00923 | | 75 | a 02633 
01723 | | ADEFGH, ADJ, BHJ, | beh, cfg, | af, ah, 68 — 
02523 | BCDEGJ CGI | achj, adef be 60 — 10732 
03323 | 51 _ 
| 
10623 | ABDEFH, AEF, CEH, | afj, bdg, ad, ae, 51 | FJ 
| BOCFGHJ FJ cdh, aceg 9 ———— 
10622 ABDEFH, AEF, CEH | afj, bdg, cdh, | ad, ae 54 | — ) 
| BCFGHJ | aceg, gj 
| | 
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Table 6. Designs of type 2'° 
Generators of | rant 
Scheme Generators of interactions Generators for Multipliers | D.¥. , Ist-order 
( ? ea for other for interactions 
:) number defining contrasts confounded principal block blocks pS nie eitdaniied 
with blocks 
Quarter-replicate designs: 256 treatment combinations 
i} 00(10)24 185 si 
| eno, | \ADEGHY, ACE, BOG, beej, bfgh, ad, as is is 
03494 BCFGHK ADK, AGH dfjk, abchk aj, bf, 158 is 
04224 148 AGH 
04223 poe . CEFJ, CFHK, bdg, fhj, acdf, ad, ae, 155 — 
05023 BCFGJK ACHJ bejk, cegh ah 143 -- 
| —. ACDGHJ, ADF, BFH, oj, egj, adek, | ad, ag, “m = 
' 19393 BOCEFJK BDK aefh, bghk ah 139 ZT 
Kighth-replicate designs: 128 treatment combinations 
00(10)38 | | AEFGV, ACE, CDK, bfg, acdj, on, pad = 
01833 BDGHJ, EHK aefhj, acghk dh 57 = 
02633 BCFJK oe 49 | CDK 
10732 ABDEFH, ADF, BFJ ad, bej, cgk, bf, oj 40 — 
BCFGHJ, egh, af jk 
ABCDFJK 
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Table 7. Designs of type 2" 






























































Generators of — 
Scheme | Generators of interactions Generators for Multipliers | #2. het-soihee 
: eae: for other for interactions 
number | defining contrasts confounded principal block 
é blocks error confounded 
with blocks 
= 
Eighth replicate designs: 256 treatment combinations 
00(11)34 | AO ADH, BCE, ahjl, acdeg, ae, bh, { 174 siti 
01934 pet centpl BDG, DEK befgl, cefik fg, abd \ | 165 ~ 
02734 ACGJK, FK, CEF, ahjl, abdgl, aj, bd, 156 FK : 
EGHKL, DEG, EHJ acegj, def jk bf, acd | 
ABDEFGJ 
03534 ABCFKL, ACE, ADH, cegl, acfhk, bl, ck, 145 ABK \ 
ACEHJK, AFJ, BFH bdghk, abchjl dg, ej 
ADEFGJ 
01933 : 173 — 
02733. | | AF HJK, BEL, BFK, avkl, acg), aj, bd, 163 ie 
ossss | [| BDFHL, CEJ ce 152 Ss 
04333 CEGHKL afhk, abcef 140 an 
10833 | | meee ADF, BEG, af, bghj, dfhl, | bk, ej, { 149 igs 
11633 | pred CDL egik, chjkl dg 136 ce 
' 
Sixteenth replicate designs: 128 treatment combinations ' 
| ) ACDEH, 
00(11)43 | | BODFJ, ACJ, AEF, adehj, beef j, acj, ad f, { 54 _ 
01943 ABCDGL, BCG cghjk, def kl aeg 45 — | 
BCEGJK 
Table 8. Designs of type 2” 
Sixteenth replicate designs: 256 treatment combinations 
00(12)44 163 | ) 
ACEHK, ; 
01(10)44 BOFGJ, AEL, AGJ, acegk, adefj, ae, abc, 153 | LM 
02844 DGJKL BHL. LM abefjlm, adk, 142 | 
03644 PHIL Mu . abcdef gh gjm 130 ; 
04444 118 LM, GHK 
00(12)43 170 — 
ACEHK, P 
01(10)43 | |" Bora, AEL, AGJ, gjm, behm, as, abo, | | 1% ~ | 
02843 | | DGJKL BHL acegk, adk ue = | 
03643 FHJLM adefj, abefgl 137 — | 
04443 ; 124 — 
ACDEFHK, BJ, EG, FL, : 
10944 BCDEFGJ, | ADG,CDF, bjm, aeghk, cd, cel, 129 ACH 
11744 CDEJKM, | COGK, BJ efhkl, cdeghm| acjl,ehjl| | 116 BJ, EG, FL, 
CDFGHL ACH, ADE 
ACDEFHK, | aiatuiae 
10943 BCDEFGJ, | ADG, CDF, yng , ed, cel, { 133 _ 
11743 CDEJKM, CGK ° acjl 119 _— 
CDFGHL cfhkl, edeghm 
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Table 9. Designs of type 2% 
































Generators of Multipliers | p er 
Scheme | Generators of interactions Generators for po ‘ail Raisttcad: +ve 
s RE for other for interactions 
number 'defining contrasts; confounded principal block 
| : blocks error confounded 
| with blocks 
| 
| Thirty-second replicate designs: 256 treatment combinations 
ACEGEK, 
00(13)54 ADHJN, acefgj, bdeghl, acn, bjn, 149 —- 
oiijs4 |} ABoasm, | 40M, 200, cefhleen, dfn, { 138 or 
02954 ACDEFM, ‘ dfghjkn abdk 126 — 
ACHKLM 
ACEGJ, 
| 0763 || Frew ADF, BCDG, ee bdfm, acl, cek, f | 121 = 
| 04553 ABOFHK, BCEFH edfin, oghilen cfg 108 | GHK 
ABDHJL 
| 10(10)53 | ADH MN, ADE, AFH, bden, clmn, acn, adf, 117 | GJ 
| CEGEKN, BEF gjkl, ahj 
BCDEFN, defhmn, 
BCGHJN, abcdf kl 
BCKLMN 
| 
Table 10. Designs of type 24 
| Sixty-fourth replicate designs: 256 treatment combinations 
| 
‘(1463 | \ACBHY, 144 
‘01(12)63 | | BCFGM, achjm, dehin 132 
ABDFHK, ACF, ADH, : a cfh,aefg, 
02(10)63 glmnp, abdf jn, 119 GP 
| FGHJKL, GP ahlp 
03863 cf jkin 105 
-— |e. 90 
ADEFGHN 
| 
| 10(11)63 | ADEFG, ADP, BDK, aefgp, cfghn, cjp, hmn, 99 JM 
AGLMN, JM dfhkp, abcdhl, afkm 
BDEJP, egjlmn 
BEFHM, 
CDFEP, 
ABDEKL 
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Confidence limits in the case of the geometric distribution 


By KERMIT G. CLEMANS 
U.S. Naval Ordnance Test Station, China Lake, California 


INTRODUCTION 


This paper presents central confidence belts for estimating m, the expected number of trials before 
failure, when X, the number of trials before failure, has a geometric distribution 


Prixy=k)=p*o (&=0,1,32,..-), 
where p and gq are positive constants with p+q = 1. The expected value of X 


E(X) = p/qg=m 
hence p = m/(1+m) and gq = 1/(1+™m). 

This model is of interest in estimating the mean life of ordnance devices that have passed acceptance 
tests and have an operating life throughout which the probability of failure is constant. Consider 
a sample of N such devices randomly selected from a population and each subjected to a series of identical 
use cycles until it fails. Let X; be the number of trials before failure of the ith device. If the X,; have 
identical geometric distributions, a sufficient estimator of the mean m is 


” N 
m= > X,/N. 
i=1 


N 
It is further known that >» X;, has a Pascal distribution (Feller, 1950, § 11-3), that is 


i=1 
N me 
Pr( > ae t) = é )p'a" (k = 0,1,2,...), 
i= 


where p = m/(m+1) and gq = 1/(m+1). The distribution is bimodal with modes for & X,; = m(N—1)-1 
and m(N—-1), E(2X,;)=Np/g=Nm, and var(=X,) = Np/g?= Nm(m+1). Then E(m) =m, 
var (m) = m(m+1)/N and 

coefficient of variation of m = J (=) o a 
The cumulative Pascal distribution is 


& N _ & (N+j-1\( m \¥( 1 \Y 
ry = Pe(B x64) = BF) eri) (wer) 


CONSTRUCTION AND USE OF CONFIDENCE BELTS 
The belts of 1 — a confidence for each N were determined by assigning m and then finding corresponding 


values k, and k, where F(ky) < fa < Fk, +1) 
and F(k,) < 1—4a < F(k, +1). 


For the purpose of constructing curves a k’ for 4a and a k” for 1— 4a were calculated by linear inter- 
polation between k,; and k,+ 1 and the points (k’/N, m) and ((k” + 1)/N, m) were plotted. 

The summation was done by the IBM 704 Computer and the program will be kept available. Belts of 
different confidence for the sample sizes used in this article are available from the author. Charts I and II 
give two-sided 90 and 98 % central confidence limits, respectively, for m, the mean number of trials 
before failure, as a function of k/N, the observed mean number of trials before failure in samples of size N. 
The charts also give one-sided 95 and 99 % confidence limits. 

In general, these confidence belts can be used in the same way as the binomial confidence belts of 
Clopper & Pearson (1934) or Crow’s tables (1956), to estimate confidence limits or to plan in advance the 
size of sample necessary for a given degree of accuracy. 

The confidence intervals estimated from Charts I and II are in agreement with those computed 
by Anscombe’s method if his extra correction terms are used when necessary (Anscombe, 1948). 
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Example 1. What are the 90 % confidence limits for m, the expected number of trials before failure, if 
N = 30 units operated for a total of k = 15,000 trials? The desired confidence limits are the ordinates of 
the intersection of the two curves for N = 30 in Chart I and the abscissa k/N = 500, i.e. 385-700. 

Example 2. What value will the mean exceed with 95 % confidence in Example 1? The desired value 
is the lower limit of the central 90 % confidence band, that is 385. 


Miscellanea 


INTERPOLATION AND EXTRAPOLATION IN THE CHARTS 


Interpolation with respect to sample size may be carried out linearly on the logarithms of the population 
mean with arguments N-}. 
Extrapolated confidence limits for the population mean for sample size N > 100 are found from the 


— logm = log (k/N) + 10N-4 |log m9) —log (k/N)|, 
where 7499 is the corresponding (upper or lower) limit for sample size 100 at abscissa k/N. 
Extrapolated population mean confidence belts for large sample means (k/N) are 
my(N) = (1000/a) (k/N) 
and mz(N) = (1000/6) (k/N), 


where a and b are the abscissas at population mean 1000 for the corresponding sample size N; see Tables 1 
and 2. To obtain values of a and b for values of N not tabled, interpolate linearly on values of log a and 
log b, using N-! as argument. 

Table 1. Value from 90% confidence belt 
















































































n| 2 3 4 5 10 15 20 30 50 100 oo 
a | 177-0 | 272-0 | 341-1 | 393-6 | 542-3 | 616-2 662-6 719-7 779-2 841-4 | 1000 
b | 2373 | 2100 |1940 | 1832 | 1572 | 1460 1395 1320 1245 1173 1000 
c | 523 3-20 2-42 1-99 1-21 0-938 0-793 0-632 0-480 0-336 0 
Table 2. Values from 98% confidence belt 
\N| 2 3 4 5 10 15 20 30 50 100 ra) 
i 
a 73-57 | 144-8 205-3 255-4 412-7 498-2 553-9 624-6 700-5 782-1 1000 
b | 3324 =| 2807 2516 | 2326 1883 1702 1598 1480 1366 1259 1000 
e | 13-29 6-55 4-47 3-49 1-89 | 1-42 1-18 0-925 0-696 0-484 0 





Example 3. Find the size of sample necessary to ensure that the 90% confidence interval for the 
population mean is not longer than 0-50 of the sample mean. This means the magnitude of the distance 
across the 90 % confidence belt measured along an abscissa should be c = 0-500 of that abscissa. Find c in 


Table 1, where . % 
c= 1000 (-;). 
a b 


and a and b are the abscissas at m = 1000 of the confidence belt. : 
The closest value is c = 0-480 for N = 50. A more accurate estimate of the sample size required may be 
found by interpolating between values of N-}, using as arguments logarithms of c. 


log (0-500) — log (0-480) 
log (0-632) — log (0-480) 
30-2 — 50-2 = 0-041153, 
N- = 50- + (0-041153) (0-148390) = 0-147528. 


This value of N-} is between 45-! and 46-!; hence the sample size is taken as 46. 


= 0-148390, 
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Note regarding Statistical Research Monographs 


The Institute of Mathematical Statistics and the University of Chicago have established a series of 
publications entitled Statistical Research Monographs. 

The primary purpose of this series is to provide a medium of publication for material of interest to 
statisticians that is not ordinarily provided for by existing media. It will help fill the gap between journal 
articles and textbooks or treatises. Among the kinds of publications envisaged are: 

New research results too lengthy for the usual journal article. In particular, authors will have ample 
scope for detailed exposition of their findings. 

Research results of interest in both theoretical and applied statistics. At present authors of such 
material frequently find it necessary to publish part of their results in a theoretical journal and part in an 
applied journal. 

Expository monographs in particular areas of statistics. 

Discussions of statistical problems and techniques in particular areas of application. 

Every attempt will be made to maintain the highest standards of scholarship. 

The Editorial Board consists of David Blackwell (University of California), William G. Cochran 
(Harvard University), Henry E. Daniels (University of Birmingham), Leo A. Goodman (University of 
Chicago), Wassily Hoeffding (University of North Carolina), Jack C. Kiefer (Cornell University) and 
William H. Kruskal (University of Chicago). 

Authors are invited to send manuscripts and correspondence concerning the series to Leo A. Goodman, 
Department of Statistics, University of Chicago, Chicago 37, Illinois. 
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REVIEWS 


The Logic of Scientific Discovery. By Karu R. Popper. London: Hutchinson and Co. 
(Publishers) Ltd. 1959. Pp. 480. 50s. 


Prof. Popper’s Logik der Forschung was first published in 1934. It was recognized from the first as 
a most important book and has had a profound effect on philosophers, though not very much on 
statisticians, except perhaps those who have been lucky enough to be able to attend Popper’s courses 
on Scientific Method at the London School of Economics. Rather surprisingly, it has not previously 
appeared in an English translation. This new version is especially welcome at a time when scientific 
discovery is proceeding so rapidly and, in particular, when statisticians are still trying to put their 
inferential procedures on a proper formal basis. 

Popper has been working on his problems since 1934, and although his views are not modified in any 
fundamental respect he now has much more to say. One imagines that he sat down to this translation 
with the idea of adding his maturer views in a few footnotes and appendices. But the new material 
nearly got out of control. Of the 480 pages of this book 156 are devoted to new appendices, twelve in 
number ; and his work on what he calls the propensity interpretation of probability has been hived off 
into a new book (Postscript: After Twenty Years) which is still to appear. 

To try to present the essentials of this book in a short review is perhaps ambitious; but I make the 
attempt in the hope that readers of this journal may be encouraged to tackle the original work. 

Popper rejects the Baconian idea of induction in science, under which the study of a mass of factual 
observations led to the expression of a ‘vintage’ of universal law. He draws a sharp distinction between 
the process of conceiving a new idea and the examination of it. How the mind thinks of hypotheses is 
not his primary concern, and in any case is not a logical process in the strict meaning of the word 
‘logic’. He is, in this book, mainly interested in the deductive testing of a theory or a hypothesis. 
Further, he admits a system as scientific only if it is capable of being tested by experience. Thus the 
principal criterion whether a system is scientific or not is that it is testable or falsifiable. 

It is not always possible to compare degrees of falsifiability, but when it is, Popper says that, of two 
statements, the one which is less falsifiable is the more probable. But this is a kind of probability, 
‘absolute logical probability’, or a priori probability which will be new to the statistician and is not to 
be confused with numerical chance. The more a statement forbids, the more it says about the world of 
experience, and hence the greater its empirical content, its falsifiability and hence its testability ; but 
the smaller its absolute logical probability because, to put it shortly, it forbids a larger class of possible 
events. 

Popper then equates the degree of falsifiability to the simplicity of a hypothesis, and has some very 
interesting comments on the concept of simplicity itself. Thus he arrives at the schema 


testability = high prior improbability = paucity of parameters = simplicity. 
This is to be compared with Jeffreys and Wrinch, who effectively would have 
high prior probability = paucity of parameters = simplicity. 


At this point, as he himself recognizes, Popper seems to be heading for trouble. For if the para- 
meters in a hypothesis may take an infinite set of values the prior probability of any particular hypo- 
thesis is zero; and, in fact, it was to avoid this difficulty that Jeffreys set up his method of approach to 
prior probability. But Popper has an answer to this. The assertion that a hypothesis has a non-zero 
probability is not itself testable and, whatever its metaphysical value, has no value or validity in 
science. We should therefore not be concerned with the probability of hypotheses but with their degree 
of corroboration. It is possible to go on learning about a theory, to test it more and more, and to increase 
its degree of corroboration, without increasing its logical probability, which remains at zero. 

Popper then has to set up a theory of corroboration (Bewiéhrung). In earlier work he and, following 
him, Carnap have used the words degree of confirmation, but this expression he now discards as mis- 
leading (and, in fact, as having misled some of his critics, including Carnap). Popper distinguishes 
between ‘probability’ in the sense of relative frequency, ‘logical probability’ in relation to statement, 
and ‘corroboration’. In statistics he has accepted only the relative frequency interpretation of 
probability, though he has since modified this viewpoint by formulating his propensity theory. Within 
the framework of frequency theory he has in the first instance to dispose of two frequential problems: 
(a) the problem of the random sequence; this he does, as I understand it, by modifying the field of 
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possible tests for randomness by making it denumerable; (b) the problem that no assertion about 
a probability is testable because (again putting it roughly) anything can happen by chance; this he 
overcomes by an assumption rather akin to d’Alembert’s, that events of small probability simply do 
not yield occurrences in Nature. 

These difficulties behind him, he can proceed to a theory of corroboration. It is not so much the 
number of corroborating instances which determines the degree of corroboration as the severity of the 
various tests. The greater the possible severity, the greater the falsifiability ; and hence the simpler 
hypothesis is more corroborable. The degree of corroboration of x by y is then not the same thing as the 
probability of x given y; and in fact it is possible to construct examples in which 2, is strongly supported 
by y and 2, is strongly undermined by it, but for which P(x,|y) < P(«,|y). 

Nevertheless, the degree of corroboration is defined as a function of probabilities. Popper’s original 
method of doing so may, perhaps, require modification, but at least he showed that a consistent 
system obeying his axioms is possible. He thus measures the rationality of accepting the guess which 
generated the hypothesis, and this seems to be about as far as numerical evaluation of the acceptability 
of a theory can go. 

The book contains a good deal of technical matter which will be mainly of interest to the logician, 
and some replies to criticism which will interest only those who are aware of the work of the original 
critics. Moreover, a final judgement of the system must await the sequel volume. Nonetheless, this 
book remains an outstanding contribution to the problem of the utilization of probabilistic ideas in the 
evaluation of hypotheses and will repay detailed study. 


Reviews 


M. G. KENDALL 


Experimental Designs in Industry. [Symposium held November 1956 at North 
Carolina State College.] Edited by V. CLew. New York: John Wiley and Sons Inc. 
London: Chapman and Hall Ltd. 1958. Pp. xi+268. 48s. 


This book contains nine papers on experimental design read at a symposium held in November 1956 at 
North Carolina State College. The papers are grouped in two Parts. Part I contains four substantial 
papers (192 pages in all) containing, between them, most of the experimental designs which are known 
to have been found useful in industrial research. Part II contains five rather briefer papers on applica- 
tions of experir.ental design techniques to specific industrial problems. The book concludes with an 
extensive twelve-page bibliography. There are also copious references given with some individual papers. 

The outstanding feature of the first part of the book is the coherence and continuity of the four 
papers contained in it. This is an unusual quality in a symposium, possibly due to luck, but more 
probably reflecting some care in planning. In the first paper (Basic Experimental Design), the editor 
gives a clear, competent introduction to the general theory and application of all the simpler designs, 
including an account of the general linear hypothesis approach. This is followed by papers on: com- 
plete factorials, fractional factorials, and confounding (R. L. Anderson) ; simple and multiple regression 
analysis (R. J. Hader & A. H. E. Grandage) and experimental design for exploring response surfaces 
(G. E. P. Box & J. 8. Hunter). These develop, in a natural way, the basic structure described in the 
first paper. 

It would be quite possible for the unaided, mathematically inclined, student to obtain a good 
idea of modern experimental design from these four papers. They do not, of course, form an ‘ideal’ 
text-book—in particular, the theoretical bases underlying the numerical procedures are not always 
sufficiently clearly described for pedagogical purposes—but they do describe, in a clear unambiguous 
fashion, the procedures which are actually used. 

The papers on specific industrial applications naturally form a rather less closely knit group. They 
are, however, of considerable intrinsic interest, enhanced by the fact that they give actual designs, data 
and analyses. The topics covered include examples of incomplete block design, fractional replication, 
and response surface design; and a short paper on ‘Design in ordnance experimentation’. 

This is a book which should prove of real value to serious students of statistics and others wishing to 
learn something of the techniques and outlook of modern experimental design. It is an unpretentious 
book (typescript with a number of surprising slips in spelling) and does not claim more for its subject 


than is justified. It is also quite inexpensive, by present-day standards. N. L. JOHNSON 
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Analysis of Multiple Time-Series. [No. 1 of Griffin’s Statistical Monographs and 
Courses.] By M. H. QueNnovurLLEe. London: Charles Griffin and Co. Ltd. 1957. 
Pp. 105. 24s. 


This is the first in a series of monographs on specialized topics which are being edited by Prof. M. G. ° 
Kendall (the second was reviewed in the last issue of this journal). 

Mr Quenouille’s book is remarkable in that much of what it contains is new work developed over 
a relatively short period. The author is concerned with an extension to stationary multiple series of the 
correlation properties, which are well known in the case of single series and also makes a start with the 
associated inference problems, confining himself almost entirely to large sample theory. Specifically, 
the models which are considered are linear of the form H(D)X, = G(D)e, where H(D) and G(D) are 
matrices whose elements are algebraic functions of the shift operator D, X, is a vector of p elements 
representing the simultaneous values of p series at time ¢ and €, is a px 00 matrix of uncorrelated 
variables extending backwards in time. One would have liked to see at the outset a statement con- 
cerning the uniqueness of this representation in the spirit of Wold’s theorem for single series. 

In the case where G(D) =I, the unit matrix, the correlation properties of the X, are determined by 
the roots of the determinantal equation |H(D)| = 0 and these may be real or imaginary in pairs. It is 
shown that much simplification is obtained if a transformation is made to a canonical form in which 
H(D) is diagonal with elements which are the factors of |H(D)| = 0. In the case where these factors are 
real, the transformed model is that of a multivariate Markoff scheme viz. AyX*+A,X*_, =ef and 
these are given special treatment in what follows. 

Chapter 3 is concerned with the problem of Identification, namely, that the parameters of the scheme 
cannot be uniquely determined from the covariance structure. This is true even for the model cited 
earlier, but the situation is made more complex by the effect of superposed error. In the case of a single 
series this is equivalent to mixing the series with an independent random series of unknown variance. 
Clearly, one could make the situation more hopeless by adding an autocorrelated series with unknown 
autocorrelation structure, in which case it would follow that the two series could not be separated 
without further knowledge or specification. 

Chapter 4 deals with inference problems and the methods which are developed are illustrated by 
means of artificially generated multiple series. Chapter 5 is devoted to miscellaneous topics and is 
intended to demonstrate how the analysis may be complicated in practice due to the omission of 
relevant variables, moving average residuals (i.e. G(D) +1), superposed error, non-linearities, trends 
and short series of observations. A very interesting method of trend analysis is proposed in which the 
differences of the correlations rather than those of the original series are used. Next follows chapters 
on estimation and goodness-of-fit tests and finally a last chapter in which a practical example (five 
American economic series) is subjected to the various techniques developed earlier. 

It is unfair perhaps to criticize a book which explores so much new ground, but it is necessary to draw 
attention to the fact that it should not be read uncritically. Thus, the use of criteria of the form C,C,_,, 
where C, is the covariance matrix corresponding to lag s, as a means of deciding on the order of the 
scheme is clearly unsatisfactory for moving average residuals. In the case of a single series these 
matrix quotients are the partial serial correlations and these are zero beyond the kth for a kth order 
autoregressive scheme but never zero if the residuals are moving averages. The chapter on estimation 
contains several surprising statements, for example, that the lower serial correlations form a sufficient 
set for the estimation of the parameters of a moving average scheme. Again, it is surprising that the 
effect of mean corrections on the serial correlations is given such little space, despite the fact that in 
small samples they may have considerable effect on significance tests and estimation. The relations 
between continuous and discrete schemes given on pp. 48-50 are interesting, but not very useful since 
one is rarely in a position to say that one is sampling from a ‘continuous’ scheme governed by a speci- 
fied stochastic differential equation—in spectral analysis it is necessary to ensure that there are no 
oscillations between the sampling points, using some preliminary filtering where necessary. 

A general point which may occur to other readers is that the approach to time-series which is pursued 
in this monograph is entirely empirical—this is no doubt related to the author’s interest in particular 
subject-matter fields where no other approach seems possible. In contrast to this it is possible in 
electrical engineering applications to specify the X, and €, in such a way that the problem of identification 
disappears. Also, a linear model is used only when it is physically meaningful or else as an exploratory 
approach before more realistic non-linear models are used. 

However, these criticisms in no way detract from the overall excellence of this monograph, an 
outstanding feature of which is the very elegant use of matrix methods. It is not difficult to predict 
that it will become a standard book worthy of serious study for years to come. G. M. JENKINS 
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Fundamentals of Statistical Reasoning. [No. 3 of Griffin’s Statistical Monographs 
and Courses.] By M. H. QuENoumLE. London: Charles Griffin and Co. Ltd. 1958. 
Pp. 169. 24s. 


‘The practical man seeking a step-by-step explanation of how to carry out statistical calculations will 
not find it here. Nor will the mathematician find proofs of the formulae involved in deriving such 
procedures. If either should, however, be interested in the foundations of statistics, in the principles 
rather than the proofs or practices, this monograph is aimed at him.’ (From the author’s preface.) 

After this introduction, the present reviewer was somewhat disappointed to find that the first two 
parts (Basic Concepts, Deductive Methods) have been devoted to an exposition of the mathematical 
concepts used in statistical theory, such as is covered by the first part of Anderson and Bancroft’s 
Statistical Theory in Research. There is very little discussion of the relation of these concepts to 
statistical practice in the real world. The treatment is superficial and in parts inaccurate. One example 
must suffice: thus ‘independence’ (of events) is never defined, and the word is first used in the phrase 
‘independent exhaustive possible events of a single trial’. 

A great improvement is apparent in the final part (Inductive Principles) which occupies over half the 
book. The Neyman-—Pearson theory is sketched, and the work of Jeffreys and of Wald is mentioned, but 
the main emphasis is on an outline of a development of fiducial theory from axioms appropriate to 
a measure of belief. Some rules are given as to when joint fiducial distributions can be found and 
integrated; these appear to give a self-consistent theory, but there is still some difficulty in deciding 
whether the rules are satisfied in any given case. It is to be hoped that Mr Quenouille will continue to 
develop his line of approach. 

Professional statisticians (who should be both mathematicians and practical men) will be stimulated 
by this final part, and plain mathematicians may be intrigued; but Mr Quenouille’s practical men are 
likely still to require convincing that the theory outlined has any relevance to their problems. 


©. L. MALLOWS 


Multivariate Correlational Analysis. By P. H. DuBots. New York: Harper and 
Brothers. 1957. Pp. 202. $4.50. 


Statisticians of the sophisticated sort are nowadays inclined to take a condescending attitude to 
correlation analysis and to attempt instead to operate as far as possible within the framework of 
regression and variance analysis. Indeed, it is hard to imagine what would have become of some of 
them if Fisher had never existed. Not so the psychologists, however, many of whom appear to be still 
contentedly following in the wake of Galton, Pearson and Yule. 

The prime purpose of the present book, written for non-mathematicians, is to set out systematic 
methods of calculating Yule-type partial and multiple correlations. Its subsidiary purpose is to give 
a brief account of, and to relate to correlation analysis, the methods of factor analysis developed by 
Spearman and Thurstone. It is regrettable that scarcely any mention is made of orthodox modern 
statistics, and the distinction between population and sample is almost completely ignored. Less than 
a page is devoted to sampling distributions and hypothesis testing. Consequently, although the book 
will no doubt be of value to psychological research workers it is not likely to be very helpful to statisti- 
cians in other fields. 

The book’s chief merit is its demonstration of compact computing methods similar to those of Crout 
and Dwyer for the systematic calculation of correlation and regression coefficients by pivotal reduction 
of the correlation matrix. This is done with judicious mixing of partial correlation and multiple 
regression theory in a manner much simpler than straightforward application of Yule’s theory. The 
author shows how partial variances and covariances may be identified at each stage of the reduction 
and shows how these may be combined to give correlation and regression coefficients of various kinds. 

An important but irritating problem in this field is the choice of a ‘best’ subset of independent 
variables in a regression model, ‘best’ in the sense of maximizing the multiple correlation for subsets of 
a given size. For example, in psychological work we might have the results of twenty or more tests at 
our disposal from which we wish to select the five or six which best predict the dependent variable. It 
seems amazing that no one has produced an algorithm which under suitable conditions will auto- 
matically yield the best subset, apart from routine fitting of all possible regressions which will normally 
be out of the question because of the enormous number of possibilities involved. The customary 
expedient is to fit independent variables successively, taking first the one which is most highly corre- 
lated with the dependent variable, then that which in combination with the first gives the highest 
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regression sum of squares, and so on. This method is recommended in the book under review and 
a systematic computing procedure is given. As the author points out, however, not only is there no 
guarantee that the method will yield the best subset, it is easy to construct cases where it definitely 
does not. A defect of the presentation is that no rule is given for advising when to stop adding further 
independent variables. In this respect the presentation may be compared unfavourably with that of 
Wherry and that of Summerfield and Lubin (Psychometrika, 1951). Essentially, Wherry recommends 
stopping when the contribution to the regression sum of squares, due to including a further variable, 
is less than the estimated residual variance, while Summerfield and Lubin recommend stopping when 
the increment to the regression sum of squares is non-significant by the F-test. As an additional safe- 
guard Summerfield and Lubin suggest checking that the difference between the regression sum of 
squares given by the reduced set of variables and the regression sum of squares given by the complete 
set of independent variables is small enough to be attributable to chance. These suggestions have 
obvious merits and it would have been helpful tc have had them discussed. 

Although the author’s account of factor analysis is useful in that it ties it up with the earlier treat- 
ment of correlation and regression analysis, it seems altogether too short to give one a clear insight into 
this mysterious subject. J. DURBIN 


Reviews 


Introduction to Statistical Inference. By J.C. R. Li. Michigan: Edward Bros. Inc. 
1957. Pp. 553. $7.50. 


The publishers state that this is a non-mathematical exposition of the theory of statistics written for 
experimental scientists. The mathematics are in fact kept to a minimum—there is just enough to enable 
necessary formulae to be written down succinctly and no attempt is made at proofs. The necessary 
theorems are stated as articles of dogma and sampling experiments are used to illustrate their validity. 
In this fashion Prof. Li covers the distributions of the sample mean and variance, t, F’, the variance ratio 
distribution, the one-way classification in the analysis of variance, randomized blocks, linear regression, 
analysis of covariance, factorial experiments, transformations and distribution free methods. 

The level of exposition is remarkably consistent and close to the mathematical minimum aimed at 
throughout. The writing is clear and the ideas are set out with simplicity. The reviewer feels that the 
paucity of the data of experience may be a handicap to the experimental scientists, since they tend to 
lean heavily on actual data rather than fictitious. However this is possibly a matter of opinion, and 
within its limits the book can be recommended. ¥. N. DAVID 


Teach yourself Statistics. By R. Goopman. London: English Universities Press Ltd. 
1957. Pp. 238. 7s. 6d. 


As its title implies this book is an introduction to statistics for readers with a minimum of mathematics. 
(Elementary calculus and determinants are the most advanced techniques used and when such 
techniques are used reference to appropriate texts is often given.) There is a wealth of worked examples, 
but the casual reader will need a desk calculating machine by him if he is to run through them himself. 
The field covered is the usual basic minimum: presentation of data, measures of frequency distributions, 
elementary probabilities, binomial, Poisson and univariate and bivariate normal distributions, regres- 
sion and correlation, rank correlation, least squares, partial correlation, sampling distributions of means, 
ete., elementary estimation, the ¢- and F-distributions, elementary testing, analysis of variance, 
testing in regression analysis, y?-tests of goodness-of-fit and contingency tables. 

Whilst the topics and the order of presentation are much as in older elementary texts (Yule and 
Kendall springs to mind) the mode of presentation is not, at least in the earlier chapters. The author 
being faced with the fundamental problem in such a book, of relating the theory of probability to the 
practice of statistics, has gone back to an approach which would hardly have been unusual in an 
elementary text of the early nineteenth century. For instance, he defines probability (pp. 34-35): 

‘(1) If the situation is such that we can distinguish n “‘equally probable” outcomes of a set of 
circumstances C and if these are all the possible outcomes of C then if m of these outcomes entail the 
occurrence of an event EH we say that the appropriate estimate of the probability of Z given C, p(£; C) 


is given by p(E; C) =mln. 
(2) Otherwise, if in n occurrences of a set of circumstances C the event EH has occurred m times the 
appropriate estimate of the probability of E given C is 


p(£E; C)=m/n.’ 
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And again, if in N trials, the score 2; is obtained n; times, 7 = 1...n he states (on p. 43) 


Reviews 


n 

‘E(x)= lim] > nial | : 
N>o Li=1 

(allowing for what must be a misprint). 

Whilst such statements as these are to some extent mitigated by introductory discussion, it must be 
said that the arguments used are often not only loose but such as seriously and unnecessarily to confuse 
the student. 

There is another class of loose argument also used which is due to the low level of mathematics 
assumed in the reader, namely ‘suggestive’ or heuristic mathematical proofs and these are relatively 
venial and in any case unavoidable. Indeed, they contribute to the reader’s understanding if he is 
under no illusions as to their nature. In this book, however, they are often so indirect, intricate and 
tedious that they are of doubtful utility. Further, they use such principles as, for instance, the unique- 
ness theorem for moments, without even an indication that this requires proof, and so beg the question 
in a hidden fashion. This sort of treatment can only unnerve the intelligenv reader who has a limited 
knowledge of mathematics and lead him to mistrust his own judgement. 

The book lacks an index, which is a serious shortcoming when important principles and techniques 
are introduced in an ad hoc manner, as and when they are needed for a particular application (as for 
instance, criteria such as bias, efficiency, etc. of estimators or the principles of testing statistical 
hypotheses). 

The concepts of sufficiency, maximum likelihood estimation or power of a test do not seem to be 


mentioned. D. E. BARTON 


Concise Tables for Statisticians. By K. C. S. Pmuat. Manila: The Statistical Center, 
University of the Philippines. 1957. Pp. 50. $1.50 plus postage. 


This is a book of eighteen short tables on 33 octavo pages preceded by 14 pages of introductory matter. 
The tables fall into three groups. The first consists of seven basic tables: the normal density function 
and its integral, the percentage points (95 and 99%) of the y?, ¢, F and r (the sample correlation for 
p = 0) and a table of random numbers. The next group consists of eight tables of analogous functions 
based on normal range (rather than sample s.p.). The last group contains two tables of percentage 
points of the largest root (table 16) and the sum of roots (table 17) of the matrix generalization of the 
variance ratio for multivariate analysis. In the language of Foster and Rees, table 16 consists of the 
percentage points (95 and 99 %) of the generalized f distribution I,(k; p, q) for k = 2, 3, 4, 5 at a very 
much coarser set of intervals than Foster’s and Foster & Rees’s tables. Table 17 is an approximation 
based on fitting Pearson curves. 

The introduction, in so far as the first two groups of curves are concerned, consists of little more than 
specification of the function tabled, but the multivariate tables are more fully introduced with worked 
examples of application. No indication is directly given of the method of computation used (except 
for table 17 as noted) nor of what methods of interpolation are appropriate. References are given, 


however, to the publications in which each table (or part of it) appeared. D. E. BARTON 


Functions of Real and Complex Variables. By W. F. Oscoop. New York: Chelsea 
Publishing Company. 1958. Pp. 407+262. $4.95. 


This book—a reprint, in one volume, of two books published in 1936—deals with those branches of 
the theory of functions which are normally taught in a B.Sc. Special course in mathematics, and with 
some others, such as Fourier series, Fourier integrals, existence of solutions of differential equations, 
analytic continuation, Picard’s theorem, and the more advanced theory of conformal mapping. 

The quality of the book is, in my opinion, fairly indicated by that of the following excerpt, in which 
the terms ‘cluster point’ and ‘point of condensation’ mean ‘limit point’, and ‘upper limit’ means 
‘exact upper bound’: 

‘THE WEIERSTRASS—BOLZANO THEOREM. An infinite linear point set which lies in a finite interval, has 
at least one cluster point.’ 

Consider the points x of the line, such that, if x’ be any one of them, only a finite number of points of 
the given set (in particular, none whatever) lie to the left of x’. This point set is bounded from above. It 
has, therefore, an upper limit, G. This point, G, is a point of condensation. For otherwise it would be an 
isolated point of the set, or not belong to the set at all. In either case, there would be a point x to 


the right of G. T, ESTERMANN 
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An Introduction to Combinatorial Analysis. By JoHn Riorpan. New York: John 
Wiley and Sons Inc. London: Chapman and Hall Ltd. 1958. Pp. x+ 242. 68s. 


The great name in combinatorial analysis is undoubtedly that of the late Major Macmahon. In two 
books of unrivalled ingenuity and combinatory insight he delineated the theory as we know it today, 
knitting together the early work of De Moivre, the generalizations of Laplace and much of the elementary 
work in the field of number theory. The difficulty, and it is a real one, in reading Macmahon, is the very 
generality of the theory because although it is all there it is not easily apparent how any particular 
piece of theory may be applied in any given circumstance. 

The work of R. A. Fisher in the combinatorial field, both in sampling moments and in exnerimental 
design, has made it essential that the worker who would research in these fields should have some 
knowledge of the combinatorial approach. Previously there was no alternative but to study Mac- 
mahon: Prof. Riordan has now put us all in his debt by writing a treatise which will make the approach 
to Macmahon less painful and to a certain extent will supplement his work. 

The topics covered are permutations and combinations, generating functions, De Moivre’s theorem 
sometimes attributed to Boole and often to Whitworth, cycles of permutations, occupancy, partitions, 
compositions, trees and networks, and restricted permutations. There is no tie-up with statistical 
methods or with probability theory. Prof. Riordan’s book should, however, be made required reading 
for all who attempt to work in the field of so-called non-parametric methods. The standard of exposition 
is high and it is very easy to learn from. In the opinion of the reviewer this is an excellent treatise 
which fills a gap in the mathematical armour of the statisticians. F. N. DAVID 


Calculus of Finite Differences. By Grorcr Boote. [Edited by J. F. Moutton.] New 
York: Chelsea Publishing Co. 1958. Pp. viili+ 336. $4.95. 


George Boole, in 1860, when he was professor of mathematics at Queen’s College, Cork, wrote an 
elementary treatise on finite differences. After his death his book was revised by J. Moulton of Christ’s 
College, Cambridge, in 1872. There is no record of the date of the third edition but the Chelsea Pub- 
lishing Company note that the present (fourth) edition differs from the third in notational changes only. 

This book, refreshingly free from the modern trend towards unnecessary mathematical rigour, has 
stood the test of time well. Generations of English mathematicians, statisticians and actuaries, have 
been reared on it, and that it has now crossed the Atlantic can only be a source of satisfaction. For 
those who are not familiar with ‘Boole’ the topics covered in the first part are Interpolation, Quadra- 
ture, Summation of Series, Bernoulli numbers, Convergency, Boole’s limit for the remainder of a series. 
The second part is devoted mainly to difference equations. There are many examples in each chapter 
and a set of answers is given at the end of the bock. To re-read this book after a number of years is 
to become aware of how little advance has been made in manipulative mathematics. 

‘Boole’ can be recommended to students of all types and ages. The mathematical approach is simple 
and the amount of prerequisite learning is negligible. At the price, it is—-by modern standards—in the 
bargain field. F. N. DAVID 


A Treatise on the Analytic Geometry of Three Dimensions. (Seventh edition.) 
Vol. I. By Gzorer Satmon [Edited by C. H. Rowz.] New York: Chelsea Publishing 
Co. 1958. Pp. xxiv+470. $4.95. 


The introduction of the geometrical method in statistics by R. A. Fisher has been followed by many 
derivations and proofs in distribution theory based on this type of approach. The generalization from 
three to n dimensions is not always skilfully or accurately done, but the fact that it is done at all makes 
it a necessity for the modern statistics student to have at least a nodding acquaintance with three- 
dimensional geometry. There are several books in current use and in the reviewer’s opinion there is no 
reason why this, the seventh edition of Salmon’s book, should be preferred to them. This being said, it 
must also be remarked that this is an excellent book. 

The date of the original edition of this work is not stated, but it was revised in 1911 for the fifth 
edition and again in 1927 for the seventh edition here reprinted. Salmon, who appears to have been 
an inveterate writer of text-books, almost rivalling Todhunter, wrote his treatise on conic sections 
in the 1870’s so presumably this present work will date from about that time. The topics covered 
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are co-ordinates and their transformation, geometrical interpretation of equations, quadriplanar co- 
ordinates, properties of quartics and their classification, reciprocation and duality, foci and confocal 
surfaces, cones, and the general theory of surfaces. One or two examples and exercises are inset at 
intervals in the text. The index, contrary to most text-books, is both usable and informative. 

F. N. DAVID 


Reviews 


Probleme der Statistischen Methodenlehre in den Sozialwissenschaften. (Third 
edition). By O. ANDERSON. Wiirzburg, Germany: Physica-Verlag. 1957. Pp. 358. 
24.50 DM. 


This is the third edition of a book first published in 1954 in the excellent series of monographs issued by 
the German Statistical Society. As far as can be judged, it has become a standard ‘intermediate’ text 
in the German literature. 

The scope of the book follows traditional lines. There are chapters on the basic ideas of statistical 
methods, on measures for describing frequency distributions, on index numbers, statistical errors, 
probability, time series, association, correlation and so forth. As the name of the book implies, its 
purpose is to highlight problems, rather than to give a comprehensive account of methods. This is all 
to the good and makes the book more interesting to read than the standard text-book. The level of 
approach is largely non-mathematical and should present few problems to anyone with ordinary school 
mathematics. Yet the book offers more than this implies, in that the basic derivations and mathe- 
matical background for the text are given in a 100-page mathematical appendix. Thus the interest of 
the book is extended to a wider and mathematically more sophisticated audience. 

Certain aspects of order and balance are open to criticism. The placing of the chapters on index 
numbers and on statistical errors so early in the book is difficult to justify. More important, it seems to 
the reviewer that there should have been much greater and clearer emphasis on the basic concepts of 
sampling theory and sample design, and on problems of statistical inference as opposed to description. 
Conversely, the discussion of correlation (though not of regression) might have been shorter. 

But these are matters of opinion which should not obscure the real value of Prof. Anderson’s text. 
Students—for whom the book was originally intended—and social scientists generally can hardly fail 
to be stimulated by its lively exposition and by the many illustrations and analogies presented in the 
text. A good example of Prof. Anderson’s approach at its best is the discussion of cost-of-living indices: 
in the course of some twenty pages virtually all the main problems of index number construction are 
discussed with reference to what is probably the most widely publicized and misunderstood statistic 
there is. . 

One other feature of the book deserves mention. Prof. Anderson has taken the opportunity of this 
new edition to bring his usage of technical terms into line with that reeommended for the German 
section of Kendall and Buckland’s Dictionary of Statistical Terms. This is an admirable step which 
other authors would do well to follow. Perhaps it is not too much to hope that a growing uniformity 
in the use of technical terms will be followed by some standardization of statistical notation. 


C. A. MOSER 


Demogra.ia, Vol. I, Part 1. Budapest: Kézponti Statisztikai Hivatal. 1958. Pp. 159. 
12Ft. 


This new journal is mainly in Hungarian with brief summaries of articles in Russian and English. The 
wide gulf between Hungarian and the languages with which one is more familiar implies that by no 
means all statistical tables are understood. 

The first paper—A Few Problems of Hungary’s Demographic Policy—includes an attempt to 
identify the influence of recent legislative measures—the 1953 ban on the use of birth control practice, 
its rescinding in 1956, and the legalizing of abortion. The author stresses the urgent need to reduce the 
apparently iarge number of abortions by encouraging the use of contraception—as yet not widely 
employed. It appears that the original paper includes details, omitted from the English Summary, 
which would prove interesting to many Western demographers. 

Two other papers, on the measurement of infant mortality and population projections, rest heavily 
on recent and now familiar U.N. work in these fields. A fourth paper deals with the questions that 
should be asked and tabulations made in the 1960 Hungarian census. 

Five shorter articles cover: Hungary’s Vital Statistics in Recent Years (crude rates and trend in 
number and age structure of population); Industrial Commuting in Hungary; A study of 2000 cases 
examined by the National Institute for Sterility Research (abortion is found a major cause of secondary 
sterility); Preparation for the 1959 U.S.S.R. census, and Deaths from Heart Disease. 
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The impression is gained that in problems of methodology, the effort of overcoming the language 
difficulty will not be repaid, but the situation is quite different in relation to more sociological questions 
involving the Hungarian way of life. 


Reviews 


N. H. CARRIEP, 


American Housing and its Uses. By L. Winnicx. New York: John Wiley and Sons 
Inc. London: Chapman and Hall Ltd. 1957. Pp. 143. 44s. 


This statistical study of density of occupation of rooms in the U.S.A. is one of the most interesting 
investigations in the housing field of recent years, and Mr Winnick’s scholarly treatment inspires 
confidence in his conclusions. The main data used is that of the U.S. Census statistics of the numbers of 
persons per room for households of different sizes and houses of different types and sizes. Mr Winnick 
measures density of occupation, space utilization as he calls it, by the ratio of persons to rooms, the 
PPR ratio; while this is, he points out, an imperfect measure for many purposes, it is the best the data 
permits. Information is also available about house rents and values, types of tenure and household 
incomes, in sufficient detail for effective examination of the relation. between variations in them and in 
the PPR ratios. Perhaps Mr Winnick’s most important conclusion from this study is that size of 
household tends to be more important than either rent or income in determining variations in the PPR 
ratio, and he finds that in consequence the range of incomes is much greater than that of the PPR 
ratios. A multiple correlation analysis of data for a number of cities tends to confirm his conclusion. It 
is of particular interest that increases in the number of rooms per person and decreases in the PPR 
ratios have been on the average small compared to changes in reai income since the beginning of this 
century, though, as Mr Winnick points out, this is, entirely consistent with the other results. He 
suggests that the great relative increase in the cost of building as well as the emergence of new durable 
consumer goods such as motor cars, provides some explanation of the relatively slight decline in the 
number of persons per room since the beginning of the century. 

It is impossible to give any indication here of the many other important conclusions Mr Winnick 
reaches. Their interest to housing experts in this country is enhanced by the fact that the general 
pattern of space utilization in the U.S. in terms of PPR closely resembles that in this country. The 
excellent use in the inquiry of data on tenures, rents and incomes to throw light on the pattern of 
demand for room space demonstrates the desirability of obtaining more information about them in this 
country through the Census of Population. MARIAN BOWLEY 


Genetics and the Improvement of Tropical Crops. An Inaugural Lecture by Sir 
JosePpH Hutcuinson. Cambridge University Press. 1958. Pp. 30. 3s. 6d. 


All who attended Prof. Hutchinson’s Inaugural Lecture felt it a memorable occasion, being an exposi- 
tion, by a master, of the lessons which the recent era of plant breeding can bequeath to the next phase 
of the art. All improvement programmes hinge on the variability of the material initially available, 
and Hutchinson gives a penetrating discussion of the origin of variability in wild and crop plants. 
Variability is inversely related to selection pressure which depends on population size and ecology. 
Special importance attaches to the breeding system. Variability is lost in the spread of an inbred crop 
plant, but is maintained if outcrossing occurs with appreciable frequency. Systems of improvement 
depending on a limited number of inbred lines necessarily involve early loss of genetic potentiality. The 
way forward, particularly in providing local races for the underdeveloped countries, would appear to 
lie in the interbreeding bulk or in recurrent selection. In all plant breeding work, however, as Prof. 
Hutchinson indicates with telling examples, there are two constant requisites for success. The selection 
programme must keep to a clearly formulated aim. This necessitates methods of precise statistical 
control. The reader may expect that plant breeding will continue to be a progenitor of new biometrical 


techniques. A. R. G. OWEN 


Morphological Integration. By E. C. Otson and R. L. Mutter. The University of 
Chicago Press, for whom Cambridge University Press act as agents. 1958. Pp. 317. 
758. 

This book is a collection of material by two biologists, one a palaeontologist and one a marine geologist. 


Profs. Olson and Miller have suggested theoretical methods for the classification and correlation of 
biological data and, contrary to general practice, have tried out their theory on actual observations. 
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The reviewer is unable to judge of the worth of their theory from a biological point of view, but from 
a general scientific standpoint it is sensible and constructive. Broadly speaking the authors recognize 
that all physical measurements on any one biological unit are correlated. (It was the existence of such 
correlation which led Karl Pearson to develop the theory of multiple and partial correlation some fifty 
years ago.) Profs. Olson and Miller discuss regression and partial correlation models, and also models 
where the data are considered relative to their biological function. They thus get two types of measure, 
the p-type in which correlations, etc. are found and the F-type in which are measures associated 
according to their biological function. 

Statisticians should read this book if only to get some idea of the ‘old-fashioned’ view of biometry 
which is just now becoming fashionable again. The wealth of data is also useful from many points of 
view. It is also refreshing to read a book which is not a text-book of statistical theory in disguise, but 
one in which the elementary statistical ideas play an important but secondary role in producing a new 
biological theory. 


Reviews 


F. N. DAVID 


Scientific Programming in Business and Industry. By ANDREW Vazsony1. New 
York: John Wiley and Sons Inc. London: Chapman and Hall Ltd. 1958, 
Pp. xix +474. 108s. 


New books on mathematical techniques of operational research follow one another 30 closely, even from 
the same publishers, that it is natural to look for distinguishing features, concerning either topics, or 
treatment, or both. As to topics, the book under review contains in three parts (The Fundamentals, 
Mathematical Programming, Programming in Production and Inventory Control) 2 chapters 
introduction and illustration, 4 on Linear, 1 on Convex and 1 on Dynamic Programming, 1 on the 
Theory of Games, and 4 on Inventory Control and Scheduling. In University lectures, the author has 
covered ‘a good part of the text in a six-month period of 45 h of lecturing’ (p. ix). 

As to presentation, operational research techniques can be treated as branches of applied mathe- 
matics, with theorems, proofs, corollaries, etc., or as parts of case studies, where they gain interest from 
their (often spurious) realism, and lose in generality. 

The author claims that ‘the method of presentation...is different from that of other mathematical 
books....There is not a single “‘proof”’ in this book. Instead of proving theorems a great deal of effort 
is spent in presenting arguments so that they make sense’ (p. vi). 

Much as the reviewer sympathizes with such an anti-purist aim, he does not feel that the problem 
has been solved here. ‘There are a lot of equations in the book...because they are the best way to 
describe the particular business problem’ (p. vi). Precisely. But having been presented with notation 
and functional relationships, the reader is then treated to lengthy verbal explanations, and the 
mathematics is wasted. Also, such an approach is in danger of slipping up: we are told on p. 284 that 
it was proven in Chapter V that the functionals of two dual problems (in Linear Programming) have 
the same numerical optima, but on p. 153, where the theorem is stated, we read: ‘ Proof of the theorem 
is omitted here.’ It is doubtful whether either the business manager (for whom the book is written), 
or the mathematician (for whom, apparently, it is not), will be satisfied. As a matter of conjecture, it is 
the mathematician who is better served. He can in most cases guess the essence of the missing proof, 
and he can appreciate the great wealth of information in this well-written book. He will also be gratified 
at the extensive and amazingly rapid development of a subject, aimed at practical applications, but 
which must be admitted—grudgingly, or with approval—to be a branch of mathematics. 

Sources are mentioned in the text, but there is no comprehensive bibliography. There is, however, an 
author and a subject-index. The make-up of the book is excellent, and only a few misprints have been 


found. S. VAJDA 


Introduction to Operations Research By C. West CouRCHMAN, Russet L. ACKOFF 
and E. Leonarp Arnorr. New York: John Wiley and Sons Inc.; London: Chapman 
and Hall Ltd. 1957. Pp. x+645. 96s. 


Introduction to Operations Research is one of the most ambitious books yet written in this field. It has 
been developed from the contents of an annual course in operational research which is presented at the 
Case Institute of Technology and it is intended to be of use both to prospective customers and practi- 
tioners. The former are recommended to read certain prescribed parts of the book, whilst the latter are 
advised to become familiar with the whole of it. Most of the illustrative examples are taken from 
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industrial problems since these are, on the whole, the most accessible, and usually command the 
greatest interest in the audiences for whom the book is primarily designed. A warning is given, how- 
ever, that the reader should not therefore assume that operational research is peculiar to the industrial 
scene only. 

The book is divided into ten parts of which the first three and the last deal with the general structure 
of operational research. The remaining parts, the filling of the sandwich, are concerned with a variety of 
special techniques which have proved themselves to be of great use to operational research workers. 

The chapters on the structure of operational research are both the weakest and the most valuable 
part of the book. The ideas behind the design of these chapters are admirable, but unfortunately the 
authors have not been able to prevent some of the exposition being wordy and diffuse. Statements such 
as ‘It is characteristic of operations research that in the solution of each problem new problems are 
uncovered’, and the phases of an operational research problem which are listed on page thirteen could 
be applied with equal validity to many disciplines and illustrate the difficulty of pinpointing in a few 
words the essential nature of operational research itself. Chapter 2 ‘An Operations Research Study of 
a System as a Whole’, was disappointing. Although the problem outlined on p. 21 seems to require 
that the output rate of the main product be reduced, the end of the first stage of the research left this 
rate unaltered, nor is there any mention in the second stage of the research of such a reduction or, 
alternatively, of a step-up in sales promotion in order to keep pace with production. The dangers of 
suboptimization are not discussed until much later in the book. The success of the market trend analysis 
described on pp. 49-52 is a resounding tribute to the robust character of the methods used and the 
conformable behaviour of the series under examination since the level of the Type I error must 
frequently have been higher than the classical value of 5%. Chapters 4 and 5 on the ‘ Analysis of the 
Organization and on the Formulation of the Problem’, and the excellent case study of Chapter 3, are 
good and succeed in emphasizing the comprehensive approach required in operational research. The 
final chapter on the selection of a suitable team contains a useful discussion of the desirable attributes 
which members of the team should possess, but it is surprising that in a subject which is so much 
concerned with the maximization of profits and/or the minimization of costs there appears to be no 
place in the team for an economist. 

In parts IV—VIII, five types of problem which are encountered time and again in operational research 
are discussed. These are problems of inventory control, of allocation, problems concerning queues and 
waiting lines, problems of the replacement of perishable material and problems of competition and 
strategy. Most statisticians will be acquainted with these problems, since a realistic formulation of any 
one of them is almost sure to be in terms of random variables. Although it can be argued that the lack 
of mathematical sophistication in the structural chapters is an advantage, it proves a drawback in this 
technical section. The authors’ self-imposed limitations force them into lengthy discussion and a spate 
of footnotes. Further, they are, for the same reason, compelled to omit many of the more interesting 
cases of these problems. For example, most of part IV in which inventory control is considered, is 
entirely deterministic; the effect of adding restrictions to, or of altering some of the parameters in, 
a linear programming model is carried out only in a numerical example without any general rules of 
behaviour or conclusions being drawn; and although the section on queuing models discusses simple 
queues at some length, it barely mentions the problems of queues in series, of bulk service queues, and 
of queues of customers with different priorities for service, etc. The chapters on testing, control and 
implementation of solutions which comprise part IX should be prescribed reading for all operational 
research workers in order to remind them that their duties extend beyond the construction of a satis- 
factory mathematical model. 

The book is well set-up and few misprints were noticed; the worst appeared to be the wrong page 
number quoted in the index for the all too short discussion of the dual theorem of linear programming. 
The index itself is rather brief. On the other hand, an excellent list of references is quoted at the end of 
each chapter. 

Just as most operational research workers cannot agree on a definition of operational research, so also 
there are many opinions on the form which an introductory text-book should take. This is an opera- 
tional research problem in itself to which further study should be given. Introduction to Operations 
Research will be of use to the intelligent, sceptical executive who wishes to survey the field, and 
probably should be read by all operational research workers, if only for the sake of part IX. But the 
authors have been unable to find a level of exposition which is :cceptable both to consumer and to 
practitioner, and one is left with the impression that the filling could have been omitted from the 
sandwich without seriously affecting either its food value or its flavour. ALISON DOIG 
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Principles of Statistical Techniques. A First Course from the beginnings for 
Schools and Universities. By P.G. Moorr. Cambridge: University Press. 1958. 
Pp. 239. 22s. 6d. 


The appearance of this book is timely for those struggling with statistics in schools, with negligible 
direction from above in methods and application. The author has resisted the temptation to go too 
deeply into theory, and succeeds in making the book readable, stimulating and beneficial to anyone 
prepared to carry out the necessary calculations. His claim that ‘this book is an attempt to put across 
the main principles of statistical methods to students, who are fundamentally interested in the prac- 
tical applications of the subject...,’ is well founded. The thirty exercises at the end of the second 
chapter underline his attempt to cater for all tastes. The main asset of the book is the successful use of 
topics selected from many fields to illustrate principles and techniques. Dr Moore has gone some way 
towards providing a book which ought to stimulate teachers of many subjects into the realization of 
the advantages of a statistical approach. 

Guidance in the collection and tabulation of data, so rarely given, is nicely handled, and the pitfalls 
of pictorial representation well illustrated. A genuine attempt to link up probability, sampling and the 
binomial theorem has been made, either as a natural consequence of events or as the starting point of 
a theory and once again the examples are plentiful. The emphasis, perhaps by bold type, of important 
ideas, principles, tests or formulae would have helped, and more summaries like that at the end of 
Chapter 10 would have been profitable. The omission of &(O—£)?/EZ, where O,E are observed and 
expected frequencies in Chapter 11, is unfortunate, but economists should find the work on indices and 
time series in the next chapters to their benefit. Overrating the importance of correlation is given two 
shocks in the last chapter; first, by the title ‘Pairs of Characters’ and, secondly, by the excellent 
example in the last paragraph of the book. 

This book deserves wide use in schools, both for reference and class use, but the cost would appear to 
be prohibitive for the latter. A set of answers to the numerical problems would also help. 


A. P. PENFOLD 
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58. 
) CORRIGENDA 
nd | 
(i) Biometrika (1950), 37, p. 96 
a ‘On the statistical independence of quadratic forms in normal variates.’ By A. C. Aitken. 
line 30, read AVBV (or BVAV) for AVB (or BVA). 
of ) (ii) Biometrika (1958), 45, p.91 
‘Some properties of runs in quality control procedures.’ By P. G. Moore. 
ER (a) In the denominator of equation (5) 
39 read (T1+1—Tx)(l—p)a™ for (T1+1-—ypax)a™, 
(b) In the headings of the table below equation (5) 
- read 1—qm for dm: 
(iii) Biometrika (1958), 45, p. 244 
‘Conditioned Markoff processes.’ By W. A. O’N. Waugh. 
| ES cS 
} line 6, read pam] 3 van for Pitts 2 Pitts 


(iv) Biometrika (1958), 45, p. 327 

‘The properties of a stochastic model for two competing species.’ By P. H. Leslie and J. C. Gower. 
On the left-hand side of the first two members of equation (5-3) 

read L,o% for L*ci and read L,o% for L*o}, respectively. 
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